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Abstract 

A model  of  burst  errors  from  a real-time  error  bit  stream  of 
up  to  20  million  bits  per  second  is  sought.  Noise  models  and  channel 
medals  are  considered.  The  choice  is  a two-state  Markov  channel  model 
in  which  the  states  each  generated  independent  Bernoulli  random 
processes.  One  Bernoulli  process  produces  ones  (errors)  at  a high 
rate,  simulating  burst  errors.  The  other  process  produces  ones  at  a 
low  rat e , simulating  random  errors  due  to  background  noise.  The 
transition  probabilities  determine  the  average  length  of  the  bursts 
and  of  the  gape.  Relative  frequency  estimates  of  the  probabilities 
of  certain  sequences  of  one-bits  from  real  data  are  related  to 
estimates  of  the  model  parameters,  so  relative  frequencies  provide 
a basis  for  fitting  this  model  to  real  channels  using  observed  error 
sequences.  An  equation  for  the  number  of  errors  in  a block  of  bits 
is  developed  in  terms  of  the  model  parameters.  Burst  probabilities 
can  be  predicted  based  on  this  equation.  The  model  was  tested 
using  computer  simulation.  Some  discussion  is  devoted  to  how  this 
burst-error  model  can  be  implemented  in  an  actual  device  to  provide 
real-time  channel  characterizations.  This  model  aids  in  the  selection 
of  an  error  correction  code. 
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USING  INTERLEAVED  BERNOULLI  PROCESSES 
WITH  A MARKOV  PROPERTY 

I Introduction 
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Background 

A significant  problem  in  digital  communications  is  the  selection 
of  an  error  correction  code.  The  type  of  code  to  use  depends  on  the 
bit  error  rate  and  on  the  distribution  of  errors.  The  distribution 
is  important  because  errors  often  occur  in  groups  (burst  errors) . 
There  are  many  causes  of  burst  errors  in  digital  communications. 
Generally,  these  causes  axe  some  form  of  impulsive  noise.  On  wire 
lines  and  telephone  networks  most  impulsive  noise  is  man-made. 

Some  examples  are  external  noise  sources  such  as  construction  and 
maintenance  work,  or  internal  network  noise  such  as  switching 
(Ref  3 * 356) . Radio  communications  have  some  internal  noise  which 
can  be  minimized  with  design  techniques,  but  the  most  common  cause 
of  impulsive  radio  noise  is  lightning  (Ref  3*3 56).  The  duration  of 
a single  lightning  strike  can  affect  from  a few  bits  to  thousands  of 
consecutive  bits,  depending  on  the  bit  rate  of  the  channel.  The 
intense  electrical  charge  and  resulting  magnetic  fields  affect  the 
voltage  levels  of  the  received  signal,  and  cause  a high  error  rate 
in  the  receiver  output.  Between  lightning  strikes,  the  error  rate 
is  very  low  and  is  generally  caused  by  Gaussian  background  noise.  If 
the  past  several  bits  axe  known  to  be  correct  or  incorrect,  the  next 
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bit's  probability  of  being  correct  could  be  predicted.  This  uses 
the  fact  that  error-free  bits  come  in  groups;  so  if  the  past  several 
bits  are  error- free,  then  the  next  bit  has  a high  probability  of 
being  error-free  also.  Similarly,  if  the  past  bits  have  a high  rate 
of  error,  then  the  next  bit  has  a high  probability  of  being  in  error. 
Since  the  probability  of  error  for  the  next  bit  is  dependent  on  the 
previous  bit's  correctness,  then  the  error  bit  stream  is  said  to  be 
dependent . 

For  uncoded  transmissions,  the  consecutive  bits  affected  by  a 
lightning  discharge  will  not  all  be  processed  into  error  decisions 
by  the  receiver.  An  example  would  be  a receiver  using  a threshold. 
The  additive  noise  of  the  lightning  discharge  could  increase  the 
amplitude  of  the  received  signal  so  that  all  decisions  will  be  above 
the  threshold.  Then,  the  only  errors  would  be  those  bits  that  should 
have  been  chosen  as  below  the  threshold. 

When  the  burst  error  characteristics  exceed  the  capability  of 
the  error  correction  code,  the  decoded  data  output  becomes  completely 
unidentifiable.  Thus,  the  number  of  bits  in  a burst  error,  and  the 
number  of  error-free  bits  between  bursts,  are  important  distribution 
parameters.  They  are  needed  to  implement  effective  error  correction 
codes  (Ref  ljl). 

The  Problem 

The  Air  Force  Communications  Service  wants  a device  to  monitor 
an  active  communication  channel  and  determine  its  burst  error 
characteristics.  Some  of  these  characteristics  are  the  number  of 
bursts  per  unit  time  or  per  interval,  the  average  number  of  bits  per 
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burst,  the  maximum  number  of  bits  in  a burst,  the  average  number  of 
bits  between  bursts,  and  minimum  number  of  bits  between  bursts.  The 
input  to  this  device  will  be  the  digital  error  sequence  output  of  the 
Hewlett-Packard  model  HP3761A  Error  Detector  (a  stream  of  bits  where 
a one  signifies  a bit  in  error  and  a zero  signifies  a correct  bit) . 

Two  types  of  output  are  needed.  The  first  is  panel  displays  of  the 
characteristics  that  are  to  be  updated  at  some  preset  rate  determined 
by  the  operator.  The  second  type  of  output  would  be  the  characteristics 
of  the  entire  testing  period,  usually  24  hours  (Ref  1:2). 

A capability  of  testing  systems  with  bit  rates  up  to  20  million 
bits  per  second  (MBPS)  is  desired  by  AFCS.  Data  reduction  is  the 
problem  that  leads  to  the  choice  of  these  five  characteristics  by 
AFCS.  However,  fully  characterizing  the  burst  errors  for  the  entire 
testing  period  requires  more  than  the  five  characteristics  discussed 
above.  The  most  efficient  data  reduction  method  would  be  to  represent 
the  stream  of  error  pulses  with  a mathematical  model.  This  model 
will  completely  characterize  the  error  distribution  and  can  be  used 
to  determine  the  higher-order  statistics.  Defining  P(N  = n)  for  all 

*0 

values  of  n possible  will  enable  the  calculation  of  the  desired 
statistics.  The  discrete  random  variable  N is  the  number  of  errors 

0*0 

in  a block  of  k bits,  and  can  be  any  integer,  n,  from  0 to  k. 

P(N  = n)  will  be  expressed  in  terms  of  the  model  parameters,  and 

0*0 

thus  the  higher-order  statistics  can  be  determined  based  on  the  model. 

Such  a model  will  define  the  device  desired  by  AFCS  by  determining 
how  to  use  the  HP3761A  Error  Detector  output  to  calculate  P(N  = n) . 

0*0 

The  purpose  of  this  paper  will  be  only  the  development  of  the  model. 

The  building  of  an  actual  device  will  be  left  as  a follow-on  project. 
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Model  Selection 

A well  designed  model  will  characterize  the  desired  process, 
enabling  prediction  of  future  performance,  and  ideally,  it  will 
model  closely  the  physical  nature  of  the  process.  The  next  chapter 
references  the  physical  nature  of  burst  errors,  and  discusses  an 
attempt  to  use  a marked  point  process  as  a noise  model  that  generates 
burst  errors  (Ref  20:128). 

n(t)  = £ Wm  6(t  - Tm)  (1) 

Eq  (1)  is  a series  of  impulses  with  Wm,  a random  weight  factor,  and 
Tm  the  random  arrival  time  of  the  impulses.  This  noise  model 
represents  additive  atmospheric  noise  where  Wm  and  Tm  can  be  selected 
to  produce  any  pattern  of  burst  error  output  decisions  in  a correlation 
type  receiver.  The  point  process  model  is  not  mathematically  tractable 
for  the  application  outlined,  as  will  be  shown  in  Chapter  II. 

The  second  option  abandons  the  ideal-model  concept.  Thus, 

there  is  only  a limited  attempt  to  model  the  physical  nature  of 

the  atmospheric  noise . The  need  for  simplified  math  led  to  the 

use  of  a channel  model.  The  channel  model  characterizes  the  error 

bit  stream  directly,  rather  than  modeling  the  noise  that  causes  the 

errors.  The  selection  process,  discussed  in  Chapter  III,  leads  to 

the  two-state  first-order  Markov  model  (see  Fig  1).  The  two  states 

axe  labeled  NP1  and  NP2.  One  state,  NP2,  produces  errors  at  a high 

rate,  simulating  burst  errors;  and  the  other  state,  NP1,  produces 

very  few  errors,  simulating  the  relatively  error-free  segments 

between  bursts.  The  transition  probabilities  from  one  state  to  the 

other  are  A and  B respectively.  The  terms  (1  - A)  and  (1  - B)  are 

4 


Figure  1.  Two-State  First-Order  Markov  Model 


the  probabilities  of  staying  in  a given  state  from  one  bit  to  the  next. 
The  error  rates  of  the  two  states  are  PEI  for  NP1  and  PE2  for  NP2. 

It  will  be  shown  that  the  four  model  parameters  A,  B,  PEI,  and 
PE2  can  be  estimated  using  P(l),  P(l,l),  P(l,l,l),  and  P(l, 1,1,1), 
where  P(l)  is  the  probability  of  an  error  bit,  P(l,l)  is  the  joint 
probability  of  two  successive  error  bits,  P(l,l,l)  is  the  joint 
probability  of  three  successive  error  bits,  and  P(l, 1,1,1)  is  the 
joint  probability  of  four  successive  error  bits.  These  four  error 
probabilities  are  estimated  from  the  error  sequence  computed  by  the 
HP  detector  during  the  test.  A computer  program  is  used  to  demonstrate 
the  validity  of  the  estimation  procedure  and  the  identification  of 
the  model  parameters  A,  B,  PEI,  and  PE2. 


Content 

The  purpose  of  this  paper  is  to  develop  a workable  model 
that  can  be  used  in  the  calculation  of  high-order  error  statistics 
during  channel  tests  at  high  bit  rates.  Atmospheric  noise  models 
are  considered  first,  but  the  discussion  will  point  out  weaknesses 
that  eliminate  various  noise  models.  The  channel  model  approach  is 
evaluated,  and  a two-state  first-order  Markov  model  is  selected. 

The  main  portion  of  this  paper  Involves  details  on  how  the  model 
works,  how  it  fits  the  proposed  application,  how  to  estimate  its 
parameters,  evaluating  the  estimation,  and  recommendations. 
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II  Modeling  Atmospheric  Noise 

In  developing  an  Impulsive  noise  model,  the  approach  was 
selected  to  develop  an  atmospheric  noise  model  based  on  lightning. 
This  decision  is  based  on  the  availability  of  literature  on  lightning 
discharges  and  the  number  of  models  based  on  lightning.  The  purpose 
of  this  section  is  to  discuss  lightning  itself  to  understand  what  is 
to  be  modeled,  and  then  to  evaluate  the  various  lightning  models. 
Evaluation  will  be  restricted  to  comments  on  strengths  and  weaknesses, 
not  on  proving  a model  valid  or  invalid . 

Atmospheric  Noise 

Cloud-to-ground  lightning  discharges  are  a primary  source  of 
atmospheric  radio  noise  (Ref  14:3).  References  to  lightning  in  this 
paper  will  mean  cloud-to-ground  discharges.  A potential  difference 
between  the  cloud  and  ground  causes  the  lightning  discharge.  The 
discharge  can  be  broken  into  two  steps:  the  streamer-leader  predis- 
charge sind  the  return  discharge.  The  predischarge  is  a series  of 
discrete  leaders,  each  covering  a short  distance  (several  meters) 
until  a path  from  the  cloud  to  the  ground  Is  formed.  Each  leader  is 
about  one  microsecond  in  duration.  The  return  stroke  lasts  about 
100  microseconds,  and  goes  from  the  ground  back  up  am  ionized  path 
formed  by  the  predischarge  (Ref  14:4,5).  The  field  intensity  of 
Fig  2 shows  the  sequence  of  leaders  followed  by  the  return  stroke. 

The  return  stroke  radiates  9 5%  of  the  energy  of  the  lightning 
discharge  process.  It  is  the  predominate  atmospheric  noise  at 
very  low  frequency  (VIF)  and  low  frequency  (LF) , and  the  leader 

stroke  affects  noise  in  the  high  frequency  (HF)  region  (Ref  13131*0* 
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Measured  Electric  Field  from  a Lightning  Discharge  at  20  Km  (Ref  13«5) 


The  100  microsecond  duration  of  the  powerful  return  stroke  can  affect 
a large  number  of  consecutive  bits:  1000  bits  at  a transmission  rate 
of  10  million  bits  per  second.  There  are  many  leaders  per  return 
stroke,  meaning  that  their  effect  is  shorter,  but  much  more  repetitive. 

Thousands  of  storms,  creating  lightning,  exist  at  any  one  time 
all  over  the  earth.  Due  to  its  power,  duration  of  discharge,  and 
high  occurence  rate,  lightning  is  the  primary,  but  not  the  only,  cause 
of  burst  errors.  The  current  produced  by  multiple  lightning  discharges 
shown  in  Fig  3 demonstrates  a randomness  in  the  arrival  times  and  the 
amplitude  of  the  discharges.  For  the  purpose  of  this  paper, 
atmospheric  noise  will  be  considered  additive.  Several  authors  give 
expanded  discussions  on  the  physical  nature  of  the  lightning 
discharge  (Refs  6 ; 13 ; 14 {24} 26) . 

Model  Requirements 

The  intended  use  of  the  model  places  certain  restrictions  on  it. 
The  goal  is  to  produce  higher-order  statistics  to  characterize  the 
error  distribution.  Thus,  the  first  restriction  is  the  ability  to 
calculate  higher-order  statistics.  The  second  is  model  simplicity  and 
tractability.  This  is  due  to  the.  high  bit  rates  and  the  need  to 
estimate  model  parameters  from  the  error  bit  stream.  A complicated 
model  whose  parameters  can't  be  estimated  is  of  no  value.  The  third 
goal  is  to  have  the  model  fit  the  physical  nature  of  impulsive  noise. 
This  last  goal  is  flexible,  but  is  the  reason  for  exploring  atmospheric 
noise  models  first.  Since  the  atmospheric  noise  is  added  to  the 
transmitted  signal  and  then  processed  by  the  receiver,  simplicity  is 
even  more  Important  with  noise  models.  What  appears  as  a tractable 
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Figure  3.  Current  Waveform  of  a Typical  Multiple  Discharge  (Ref  14 j 7) 


model  can  lose  much  of  its  simplicity  after  the  mathematical 
operations  needed  to  convert  it  to  a receiver  output  are  performed. 

Why  Use  the  Point  Process  Model 

There  are  so  many  noise  models  in  existence  that  it  is  difficult 
to  choose  one.  The  three  criteria  that  have  been  discussed  eliminate 
many  of  the  existing  noise  processes.  Convenient  models,  such  as 
Gaussian  noise,  fit  the  first  two  criteria,  but  must  be  eliminated 
because  they  fail  to  model  the  impulsive  physical  nature  of  lightning 
discharges.  ] 

Empirical  models  of  lightning  discharges  (Refs  13 i 1^  j 15 ) are 
designed  to  fit  data  compiled  on  lightning- induced  noise.  Since  these  , 

models  sire  based  on  a tractable  matching  of  first-order  statistics, 
such  as  APD  curves  (Refs  2; 21),  they  generally  fail  at  producing 
higher-order  statistics.  In  addition,  most  of  these  curve-fitting 
models  do  not  model  the  physical,  nature  of  the  noise  (Refs  13?  1*0* 

This  leaves  the  point  process,  which  has  the  Impulses  needed, 
in  addition  to  meeting  the  first  two  criteria.  The  question  is,  can 

i 

its  impulseness  be  modified  to  fit  the  physical  nature  of  lightning 

( 

and  still  meet  the  first  two  criteria  given  above? 

| 

The  Marked  Point  Process 

The  main  point  of  choosing  the  atmospheric  noise  approach  over 
channel  modeling  is  to  closely  model  the  physical  nature  of  lightning, 
a major  cause  of  burst  errors.  The  marked  point  process  of  Eq  (1)  is 
developed  by  D.  L.  Snyder  (Ref  20).  The  steps  he  used  to  transform  a 
homogenous  Poisson  process  into  the  marked  point  process  are  reviewed 
here. 
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The  Poisson  process  can  be  associated  with  counting  points  or 
impulses,  £ 6(t  - Tm) . The  number  of  impulses  occurring  in  a time 
Interval  (a,  b)  is  Poisson  distributed.  The  number  of  points  in  the 
interval  is  a random  variable,  N,  with  a probability  defined  as 

?(»  - n)  = i£-Sp&l  (2) 

ns 

where 

X = X(t)  dt 

£L 

for  all  b - a.  The  process  is  homogenous  if  X(t)  is  a constant, 
independent  of  time.  It  is  an  inhomogenous  process  if  X(t)  varies 
with  time.  X is  the  average  rate  or  intensity  over  the  time  period 
(Ref  20 « 53-34).  Snyder  defines  a compound  Poisson  process  as  an 
inhomogenous  Poisson  process  with  independent,  Identically  distributed 
(iid)  marks.  This  is  in  the  form  of  Eq  (1)  with  Wm  as  the  lid  marks. 
The  marks  axe  also  independent  of  the  counting  process  arrival 
times,  Tm. 

Me 

Next,  the  unmarked  Poisson  point  process  is  expanded  where 
X(t)  depends  not  only  on  time,  but  also  on  the  previous  points.  This 
is  termed  the  self -exciting  counting  process  because  X is  now  a 
random  process  that  depends  on  the  number  of  points  that  have  occurred, 
and  can  also  depend  on  one  or  more  of  the  occurence  times  of  che 
points.  The  point  process  is  further  extended  to  the  doubly  stochastic 
Poisson  process  where  X (t ) is  a function  of  Xt»  where  Xt»  411  ®xtemal 
information  process,  is  either  a vector- valued  Gaussian  process  or  a 
vector-valued  Markovian  process.  These  point  processes  are  in  the 
form  of  Eq  (l)  without  the  marks,  Wm. 
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The  marked  point  process,  as  defined  by  Snyder,  is  a doubly 
stochastic  point  process  with  doubly  stochastic  marks.  This  is  in 
the  form  of  Eq  (l)  (Ref  20) . 

Selecting  the  Suitable  Point  Process 

The  question  is,  which  of  these  point  processes,  if  any,  meets 
the  three  criteria  established  earlier?  To  model  lightning,  as 
depicted  in  Fig  1,  for  bit  rates  up  to  20  MBPS,  each  return  stroke 
must  be  broken  into  a series  of  amplitude-varying  impulses  with  one 
in  each  bit  signal  duration.  This  will  enable  evaluation  of  the  noise 
effect  on  each  bit.  Thus,  for  a given  return  stroke,  there  will  be 
dependence  between  arrival  times  and  between  amplitudes  of  the  points 
that  make  up  the  stroke.  This  fits  the  definition  of  the  marked 
point  process.  A marked  point  process  model  accurately  characterizes 
the  physical  nature  of  the  noise  process,  but  does  not  meet  the  other 
criteria.  The  higher-order  statistics  must  be  estimated,  and  Snyder 
says  these  calculations  can  become  intractable  (Ref  20i460) . 

Hettinger  (Ref  14)  suggests  using  a simpler  Poisson  point 
process.  He  uses  two  homogenous  Poisson  point  processes,  each  with 
iid  Gaussian  marks.  One  process  has  a low  rate  to  simulate  lightning 
pulses,  and  the  other  has  a high  rate  to  simulate  the  background  noise. 
His  model  is  tractable,  but  lacks  the  dependence  between  the  marks  and 
the  dependence  of  the  arrival  times  on  previous  points.  Thus,  its 
value  is  limited  in  the  proposed  application. 

Conclusion 

The  quick  search  of  atmospheric  noise  models  was  desinged  to 
show  that  the  Poisson  point  process  is  the  best  noise  model  for  the 
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use  discussed.  However,  it  has  several  weaknesses.  When  the 
dependence  between  arrival  times  and  between  marks  Is  put  into  the 
process,  the  model  appears  to  be  intractable  for  calculating 
higher-order  statistics.  The  model  proposed  by  Hettinger  is  tractable, 
but  in  ignoring  the  dependence  in  the  lightning  stroke,  the  model  does 
not  completely  model  the  physical  nature  of  lightning.  The  physical 
nature  goal  is  flexible;  however,  if  it  is  to  be  relaxed  as  a 
criterion,  the  channel  model  approach  becomes  the  better  choice. 

The  noise  model  form  at  the  receiver  output  will  be  different  for 
each  modulation  technique  and  for  each  receiver  type.  Thus,  the 
estimation  procedure  of  the  model  parameters  will  be  different  in 
each  case,  complicating  the  problem.  The  only  advantage  of  the 
noise  model  approach  was  to  model  the  physical  nature  of  lightning. 

The  other  criteria  have  necessitated  easing  the  physical  nature 
goal,  so  the  channel  model  becomes  more  practical.  It  models  the 
error  stream  directly,  and  will  be  in  the  same  form  for  all  noise 
sources  and  for  all  modulation  techniques  and  receiver  types. 
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Ill  Channel  Model  Selection 

c 

There  axe  several  terms  used  in  channel  model  discussions  of 
burst  errors.  As  noted  eaxlier,  impulsive  noise,  such  as  lightning, 
does  not  cause  am  error  in  every  bit  it  affects.  A definition  of 
what  constitutes  a burst  error  is  needed.  Other  terms  that  must  be 
defined  include  clusters,  gaps,  renewal  process,  and  random  process. 

Several  different  definitions  of  burst  errors  can  be  found  in 
the  literature.  Here,  a burst  is  defined  as  beginning  and  ending 
with  an  error  bit.  Each  error  is  included  in  one  and  only  one  burst. 
Each  burst  is  preceded  by,  and  also  followed  by,  a stream  of  at  least 
L consecutive  error-free  bits.  Thus,  bursts  are  separated  by  at 
least  L consecutive  error-free  bits,  and  no  burst  can  contain  a 
stream  of  more  that  (L  - 1)  consecutive  error-free  bits.  This  yields 
a burst  error  density,  y»  that  will  be  greater  than  l/L  (Ref  12 i 1092). 
Other  burst  definitions  can  be  found  (see  Ref  8;llj22}23) . This 
definition  was  chosen  because  it  allows  for  error-free  bits  in  the 
burst.  It  also  appears  to  be  the  best  definition  of  this  type  for 
implementation  in  hardware  to  count  bursts  and  burst  lengths. 

A cluster  is  defined  to  be  a run  of  successive  error  bits,  and 
does  not  have  any  error-free  bits.  A gap  is  the  run  of  consecutive 
error-free  bits  between  error  bits.  By  definition,  two  consecutive 
errors  have  a gap  length  zero  between  them  (Ref  12 i 1189).  Using  this 
definition,  the  total  number  of  gaps  equals  the  total  number  of 
error  oits.  Also,  gaps  can  be  divided  into  two  groups.  The  first 
group  consists  of  the  short  gaps  that  exist  in  bursts.  The  second 
^ group  consists  of  the  long  gaps  that  exist  in  the  relatively  error-free 

► l 
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bits  between  bursts.  The  second  group  will  be  called  the  between 
burst  gaps. 

The  process  definitions  relate  to  the  characteristics  of  the 
model.  A random  process  is  defined  as  producing  independent  random 
errors j thus,  it  does  not  produce  bursts  of  dependent  error  bits.  A 
renewal  process  is  defined  as  a process  where  the  transition 
probability  to  state  j of  the  model,  after  an  error  has  occurred,  is 
independent  of  the  state  in  which  the  error  occurred.  Therefore,  the 
gaps  between  errors  are  independent  random  variables  with  the  same 
probability  distribution  (Ref  17 « 1713 . 1715 ) . The  errors  in  a renewal 
process  are  dependent.  Then  a non-renewal  process  has  dependent 
gaps  and  dependent  errors. 

Order  Markov  Models 

The  dependence  between  error  bits  and  between  error-free  bits 
in  the  error  bit  stream  has  been  discussed.  order  means  that  the 

probability  of  error  of  the  next  bit  depends  only  on  the  correctness 
of  the  previous  N bits.  Knowledge  of  the  correctness  of  bits  prior 
to  the  previous  N bits  does  not  change  the  error  prediction  of  the 
next  bit.  Thus,  the  probability  of  an  error  in  the  ith  bit,  given  the 
previous  bits,  yields 

P(Xi/Xi_i • • • *X0)  = P(Xi/Xi_i • • • ‘Xi.N)  (3) 

where  Xj.  is  the  i^*1  bit  in  the  error  stream. 

Haddad,  et  al.  propose  using  a Markov  gap  model  (Ref  12).  This 
model  assumes  that  the  gap  sequence  length  is  a discrete- time , 
integer-valued  Markov  process  of  the  first  order.  The  range  of 
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possible  gap  lengths  is  divided  into  sub-ranges  so  that  the  sub-ranges 
are  approximately  equi probable . Thus,  an  infinite  dimensional 
process  is  reduced  to  a finite  number  of  states  equal  to  the  number 
of  sub-ranges.  Manual  curve-fitting  is  required  to  determine  the 
coefficients  of  the  conditioned  gap  distributions  of  the  model 
(Ref  12:1191).  This  removes  the  gap  model  from  further  consideration. 

Another  Nti_1  order  model,  the  partitioned  Markov  chain,  is 
proposed  by  Fritchman  (Ref  10) . He  proposes  an  N state  model 
partitioned  into  two  types  of  states.  There  are  M states  that 
produce  only  error-free  bits  (gaps)  and  (N  - M)  states  that  produce 
only  error  bits  (clusters).  There  are  transition  probabilities  between 
all  states  including  continuation  in  the  current  state.  This  model 
has  a maximum  of  2M(N  - M)  model  parameters  (Ref  10:221-225). 

Fritchman  then  simplifies  his  model  to  allow  it  to  be  specified 
by  the  gap  distributions.  He  restricts  the  model  to  one  error  state 
and  (N  - l)  error-free  states.  In  additon,  he  eliminates  the 
transitions  between  error -free  states.  The  simplified  partitioned 
Markov  chain  model  is  depicted  in  Fig  4 and  has  a maximum  of  2(N  - l) 
model  parameters.  Fritchman' s models  are  feasible,  if  N is  small 
enough  to  keep  the  number  of  parameters  reasonable,  and  will  be 
discussed  later. 

The  Two-State  Markov  Model 

Gilbert  (Ref  11)  suggested  the  first  model  with  memory.  His 
two-state  Markov  model  (see  Fig  1)  has  a good  state  and  a bad  state. 

The  good  state  produces  only  error-free  bits,  and  the  bad  state  yields 
error  bits  with  a probability  P(e)  = 1 - h . The  good  state  produces 
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error-free  states 


error  state 


Figure  4.  Simplified  Partitioned  Markov  Chain  (Ref  10) 


the  gaps  and  the  bad  state  produces  bursts  of  density  (1  - h) . Elliott 
(Ref  9)  generalized  Gilbert’s  model  so  that  each  state  produces  error 
bits.  Using  Fig  1 again,  the  state  labeled  noise  process  one  (NPl) 
yields  a few  random  errors  at  rate  PEI  « 1.  The  second  state,  noise 
process  two  (NP2),  produces  many  errors,  and  can  be  viewed  as  a burst 
of  density  PE2.  The  Fritchman  models  are  extensions  of  these  two  models. 
The  Gilbert  bad  state  can  be  broken  into  two  states i one  that  produces 
clusters,  and  one  that  produces  gaps,  with  h and  (1  - h)  as  the 
transition  probabilities.  Then,  the  Gilbert  model  looks  like  the 
original  Fritchman  model  with  two  error-free  states  and  one  error  state. 
If,  in  addition,  restrictions  sure  included  where  transitions  from  the 
bad  state  to  the  good  state  only  occur  immediately  after  an  error,  and 
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Figure  5.  Generalized  Gilbert  Model  in  Partitioned  Markov  Chain  form. 

transitions  from  the  good  state  to  the  bad  state  only  occur  immediately 
before  an  error,  then  the  Gilbert  model  becomes  a simplified  Fritchman 
model  with  only  one  error  state.  Similarly,  if  the  states  of  the 
Elliott  model  are  divided  into  cluster  and  gap  states,  the  model  looks 
like  the  original  one  proposed  by  Fritchman  with  two  error  states  and 
two  error-free  states  (Fig  5) • The  states  do  not  generate  Bernoulli 
processes  in  Fig  5*  Ibe  top  two  states  only  produce  zeros  and  the  lower 
two  states  only  produce  ones.  Note  that  the  transition  probabilities 
of  this  model  reflect  both  the  transition  probabilities  and  the  error 
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rates  of  the  generalized  Gilbert  model.  The  left  two  states  combine 
to  form  state  NP1  of  the  generalized  Gilbert  model,  and  the  right  two 
states  combine  to  form  state  NP2.  There  axe  many  models  that  axe 
variations  of  Gilbert  and  generalized  Gilbert  (Elliott)  models 
(Refs  8jl7). 

There  axe  several  drawbacks  to  the  Gilbert  model.  Since  it  has 
only  one  error  producing  state,  it  is  a renewal  process;  therefore, 
the  gaps  axe  independent.  Secondly,  it  produces  only  bursts,  and  does 
not  allow  for  single,  random  errors  due  to  background  noise.  The 
generalized  Gilbert  model  corrects  these  flaws.  The  generalized 
Gilbert  model  has  two  error  producing  states,  and  becomes  a renewal 
process  only  on  the  conditions  that  either  the  transition  proba- 
bilities 1 - A = B and  1 - B = A both  have  equality,  or  if  either 
error  rate  is  zero.  Then,  the  restrictions  that  A + B ^ 1 , 

PEI  / 0 , and  PE2  ^ 0 make  the  gaps  dependent  random  variables  with 

probability  distributions  that  depend  on  the  last  gap  (Ref  17 t 1713) • 

Of  course,  the  restrictions  PE  f PE2  , A f 0 , and  B f 0 must 

be  imposed  or  the  model  becomes  a random  process. 

The  Generalized  Gilbert  Model 

The  generalized  Gilbert  model  of  Fig  1 satisfies  the  model 
requirements  outlined  earlier.  A detailed  discussion  of  how  this 
model  works  will  illustrate  that  it  meets  these  requirements.  The 
two  states  of  the  model  are  Bernoulli  events.  State  NP1  produces  a 
sequence  of  Independent  bits  with  P(x  = l)  = PEI  and 
P(x  = 0)  = 1 - PEL  . State  NP2  similarly  yields  a sequence  with 
P(x  = l)  = PE2  and  P(x  = 0)  = 1 - PE2  . The  transition  probabilities 
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are  stationary,  thus  the  two-state  Markov  chain  is  completely 
specified  by  the  single  step  transition  matrix  P 


The  key  to  the  generalized  Gilbert  model  is  the  Bernoulli  random 
variables  produced  by  the  two  states.  This  allows  the  use  of  a two- 
state  first-order  Markov  model  to  simulate  an  order  Markov  process. 
Thus,  state  NP1,  which  has  a very  small  probability  of  error,  simu- 
lates the  relatively  error-free  bits  between  error  bursts,  and  state 
NP2,  which  has  a large  probability  of  error,  simulates  the  burst 
errors.  The  transition  probability  (1  - A)  of  staying  in  state  NP1 
determines  the  approximate  number  of  bits  between  the  bursts.  The 
probability  (1  - B)  determines  the  average  length  of  the  burst.  The 
states  simulate  the  dependence  between  error  bits,  and  the  transition 
probabilities  determine  the  Markovian  order  of  the  dependence. 

The  generalized  Gilbert  model  is  very  flexible.  It  is  a 
non-renewal  model  as  defined  with  the  restrictions  PEI  f PE2  , 

A + B ^ 1 , and  with  none  of  the  parameters  zero.  However,  by 

allowing  A + B = 1 or  by  setting  one  of  the  error  rates  to  zero, 
the  model  can  be  converted  into  a renewal  model.  The  model  can  also 
simulate  a Bernoulli  random  process.  This  can  be  done  by  setting 
PEI  = 1 and  PE2  = 0 and  A + B = 1 . Then  this  random  process 
has  a probability  of  error  P(e)  = B and  a probability  of  being 
correct  of  1 - P(e)  = A = 1 - B . These  simple  conversions  mean 
this  model  can  simulate  random,  renewal,  and  non-renewal  channels. 

The  generalized  Gilbert  model  can  also  be  related  to  the 
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physical  nature  of  the  burst  error  process.  The  small  probability  of 
error  of  state  NP1  can  be  translated  into  errors  induced  by  white 
Gaussian  background  noise.  The  error  sequence  determined  at  the 
receiver  output  can  not  differentiate  between  sources  of  errors.  Thus, 
errors  produced  in  NP2  can  be  translated  into  errors  produced  by  a 
short  duration,  intense  white  Gaussian  noise  process.  Such  a simulation 
of  lightning  by  Gaussian  noise  is  unthinkable  in  an  atmospheric  noise 
model,  but  here  the  channel  error  sequence  can  not  tell  the  difference. 
The  relationship  between  probability  of  error  and  Gaussian  noise  is 
addressed  by  Van  Trees  (Ref  25).  Thus,  the  states  NP1  and  NP2  can  be 
thought  of  as  states  of  atmospheric  noise  having  the  appropriate 
Gaussian  noise  parameters  associated  with  them.  Being  able  to  view 
the  noise  as  being  created  by  two  Gaussian  processes  further  enhances 
the  simplicity  and  tractability  of  the  generalized  Gilbert  model. 

Another  property  of  this  model  is  that  the  two  states  are 
first-order  Markov.  Thus,  the  probability  of  any  sequence  of  states 
occurring  can  be  broken  into  a product  of  conditional  probabilities  by 
using  the  Markov  property  that  P(Sk/Sk_i,Sk_2)  = P(Sk/Sk_i)  . Then, 
a state  sequence  • *Si  has  probability 

P(SkSk-l”*S2Si)  = P(Sk/Sk-l)P(Sk_i/Sk-2)---P(S2/Sl)P(Si)  (5) 

where  Sk  is  the  kth  state  in  the  sequence.  These  conditional  state 
probabilities  are  the  transition  probabilities  of  Fig  1.  However,  the 
bit  sequence  produced  by  the  model  is  not  first-order  Markov.  The 
model  produces  a dependent  bit  stream  where  P(0/0,0)  f P(0/0)  . 

This  property  of  the  bit  stream  will  be  proven  in  the  next  chapter. 
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From  the  above  discussion  of  Markov  channel  models  It  becomes 


apparent  that  the  generalized  Gilbert  model  is  the  logical  choice. 
It  has  great  flexibility,  and  yet  is  relatively  simple.  It  can 
simulate  non-renewal,  renewal,  and  random  channels  with  only  four 
variable  parameters.  The  next  chapter  proposes  a procedure  to 
estimate  the  model  parameters  from  the  bit  stream,  and  develops 
an  equation  for  P(N  = n). 
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IV  Estimation  of  Model  Parameters 

1 

There  are  several  approaches  that  can  be  used  as  estimation 
procedures.  The  one  proposed  here  is  relative  frequency.  The 
probability  of  an  event  can  be  approximated  by  the  event's  relative 
frequency.  The  law  of  large  numbers  states  that  the  relative 
frequency  of  an  event  can  be  within  any  desired  accuracy  of  that 
event's  probability,  if  the  number  of  trials  is  made  large  enough 
(Ref  18:70-71) • The  high  bit  rates  and  the  long  testing  periods 
indicate  that  relative  frequency  estimation  should  be  well  within 
reasonable  limits  of  accuracy  for  the  stated  application.  The  proposed 
generalized  Gilbert  model  is  defined  as  stationary,  thus  the  transition 
probabilities  are  constant  for  all  time.  In  addition,  the  error  rates 
of  the  two  states  are  independent  random  variables  with  fixed 

#* 

probabilities  for  all  time.  The  model  does  not  change  with  time,  so 
relative  frequency  can  be  used.  These  are  reasonable  assumptions  for 
time  periods  on  the  order  of  tens-of -minutes  or  hours  during  which 
millions  of  samples  are  available. 

Since  there  are  four  model  parameters,  four  independent 
quantities  must  be  estimated  from  the  bit  stream.  These  estimated 
quantities  must  be  capable  of  being  expressed  as  equations  in  terms  of 
the  model  parameters.  The  model  parameters  can  then  be  estimated  by 
solving  the  four  independent  equations. 

Estimation  Procedure 

The  probability  of  a correct  bit,  P(0) , and  the  probability  of 
an  error  bit,  P(l),  can  be  easily  estimated  from  the  error  sequence 

r 

using  relative  frequency.  Summing  the  error-free  bits  and  error  bits 
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respectively  and  dividing  by  the  total  number  of  bits  yields  the 
relative  frequency  approximation  for  these  probabilities.  The  joint 
probability  of  two  successive  bits  can  also  be  approximated  from  the 
error  bit  sequence.  The  notation  used  here  for  the  joint  probability 
of  a zero  followed  by  a one  in  the  error  stream  is  P(1,0).  This  is 
consistent  with  the  notation  used  in  Eq  (3)  and  Eq  (3).  The  pairwise 

joint  probability  estimates  are  the  sum  of  the  overlapping  pair 

a 

combinations  in  the  sequence.  For  example,  0100* ••  has  01,  10,  00,  0** 
c.s  the  overlapping  pairs  of  successive  bits.  The  four  possible  joint 
distributions  are  summed  separately  and  divided  by  the  total  number  of 
overlapping  pairs  (the  total  number  of  bits  minus  one) . This  yields 
the  relative  frequency  of  the  joint  probability  distributions.  Fig  6 
illustrates  the  use  of  overlapping  pair  relative  frequency.  Similarly, 
the  probabilities  P(l,l,l)  and  P(l, 1,1,1)  could  be  estimated  using 
overlapping  groups  of  three  and  four  bits  respectively. 

Probability  Equation  Development 

In  developing  the  equations  for  these  probabilities  in  terms  of 
the  model  parameters,  several  properties  used  in  the  model  will  bt 
needed . First,  the  two  states,  NP1  and  NP2,  are  disjoint  and  therefore 
mutually  exclusive.  Thus,  the  model  can  only  be  in  one  state  at  a 
time,  and  the  transitions  between  states  are  considered  instantaneous. 
Second,  the  model  is  stationary,  and  the  state  transition  matrix  of 
Eq  (2)  defines  the  model  for  all  time.  These  two  properties  mean  the 
probability  of  beginning  in  a particular  state  can  be  determined  from 
the  equations 


P(NP1  U NP2)  = P(NP1)  + P(N?2)  = 1 
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(6) 


Total  number  of  bits  = 14 
Total  number  of  pairs  = 13 

Relative  Frequencies 

P(0)  ^EO's^  P(1,0)  = ^ E 10*s  = £ 

P(D  ^El's-J  P(0.D  =^01's--^ 

P(0,0)  = OO's  = ^ P(l,l)  = ll's  = ^ 

Figure  6.  Overlapping  Pair  Relative  Frequency 

and 


P(NP1)  = (1  - A)  P(NP1)  + B P(NP2)  (7) 

Solving  for  P(NPl)  and  P(NP2)  yields  the  steady  state  probabilities 

P(«PD  • j4b  (8) 

P(KP2)  = j-4-g  (9) 

These  axe  used  as  the  initial  condition  probabilities  for  the  starting 
state. 

The  notation  0 D NP1  means  an  error-free  bit  occurring  in 
state  NP1.  Similarly,  1 D NP2  means  an  error  bit  in  state  NP2. 

( The  joint  probability  can  be  expressed  as 


26 


♦ 

i 


p(o  n npi)  = p(o/npi)  p(npi) 


(10) 


i 

* 


The  occurrence  of  am  error-free  bit  cam  be  in  state  NPI  or  NP2  and  is 
expressed  with  the  notation  (0  fl  NPI)  U (0  fl  NP2)  . The  probability 
of  am  error-free  bit  is 

p(o)  = pC(o  n npi)  y (on  np2)] 

= p(o  n npi)  + p(o  n np2) 

= P(0/NP1)p(NP1)  + P(0/NP2)P(NP2) 

Substituting  the  model  parameters  into  this  equation  using 
P(0/NP1)  = (1  - PEI)  and  P(0/NP2)  = (1  - PE2)  yields 

P(0)  = (1  - PEI)  B/(A  + B)  + (1  - PE2)A/(A  + B)  (11) 

A similar  procedure  using  P(l/NPl)  = PEI  and  P(l/NP2)  = PE2  leads  to 

P(l)  = (PEI)  B/(A  + B)  + (PE2)  A/ (a  + B)  (12) 

Development  of  the  joint  probabilities  is  more  involved,  but  uses 
the  same  properties. 

p(o,o)  = pC(o  n npi)  y (on  np2),(o  n npi)  u (o  n NP2)] 

= pC(o  n npi)  u (o  n np2),(o  n npi)] 

+ fC(o  n npi)  u (o  n np2),(o  n np2)] 

* pC(o  n npi)  u (o  n np2)/(o  n npi)]p(o  n npi) 

+ p[(o  n npi)  u (on  np2)/(o  n np2)]p(o  n NP2) 
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= [p(o  n npi/o  n npi)  + p(o  n np2/o  n npi)]p(o  n npi) 

+ [p(o  n npi/o  n np2)  + p(o  n NP2/0  n np2)]p(o  n np2) 

Since  the  transition  between  states  is  dependent  only  on  the  previous 

state  and  not  on  the  correctness  of  the  previous  bit,  then 

P(0  n NPl/O  n NPI)  = P(0  n NPl/NPl)  = P(0/NP1)P(NP1/NP1)  . This  yields 

P(0,0)  = [P(0/NP1)P(NP1/NP1)  + P(0/NP2)P(NP2/NP1)]P(0/NP1)P(NP1) 

+ [P(0/NP1)P(NP1/NP2)  + P(0/NP2)P(NP2/NP2)]P(0/NP2)P(NP2) 

Substituting  the  model  parameters  yields 

P(0,0)  = [(1  - A)(l  - PEI)  + A(l  - PE2)](1  - PE1)B/(A  + B) 

+ [B(l  - PEI)  + (1  - B)(l  - PE2)](1  - PE2)A/(A  + B)  (13) 

Similarly,  the  other  joint  probabilities  are 

P(0,1)  = [(1  - A)(l  - PEI)  + A(1  - PE2)](PE1)B/(A  + B) 

+ [B(l  - PEI)  + (1  - B)(l  - PE2)](PE2)A/(A  + B)  (14) 

P(1,0)  = [(1  - A) PEI  + APE2](1  - PE1)B/(A  + B) 

+.[BPE1  +(1  - B)PE2](1  - PE2)A/(A  + B)  (15) 

P(l,l)  = C(1  - A) PEI  + APE2](FE1)B/(A  + B) 

+.[BPE1  + (1  - B)PE2](PE2)A/(A  + B)  (16) 

These  joint  probabilities  and  P(o)  and  P(l)  give  six  equations,  all 
in  terms  of  the  four  model  parameters.  However,  they  yield  only  two 
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independent  equations  in  the  four  parameters.  Since  P(l)  = 1 - p(0) 
these  two  unconditional  probabilities  yield  only  one  independent 
equation  to  solve  for  the  model  parameters.  The  four  joint  proba- 
bilities sum  to  one,  also.  In  addition,  P(0,l)  = P(l,0)  and 
P(0,1)  + P(0,0)  = P(0)  and  P(l,0)  + P(l,l)  = P(l)  5 and  combining 
these  with  either  P(l)  or  P(0)  means  that  only  one  of  the  joint 
probabilities  can  be  used  as  an  independent  equation.  P(l)  and  P(l,l) 
are  chosen  because  they  contain  PEI  and  PE2  rather  than  1 - PEI  and 
1 - PE2.  A set  of  similar  identities  show  that  only  one  of  the 
three-bit  joint  probability  equations  is  independent  when  given  P(l) 
and  P(l,l).  The  identities  for  the  eight  three-bit  joint  probabilities 
are 
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E of  all  eight  probabilities  = 1 

P(l,l,l)  + P(l,l,0)  = P(l,l) 

p(i,o,i)  + p(i,o,o)  = p(i,o) 

p(o,i,o)  + P(0,1,1)  = p(o,o) 

P(0,0,1)  + P(0,0,0)  = P(0,0) 

P(1,1,0)  = p(o,i,i) 

P(0,0,1)  = p(i,o,o)  (17) 


These  last  two  identities  and  P(0,l)  = P(1,0)  are  as  expected.  When 
looking  at  only  two  bits,  the  probability  that  one  of  them  is  an  error, 
and  one  is  not,  is  the  same  whether  the  error  occurred  first  or  last. 
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successive  errors  and  one  error-free  bit  is  the  same  whether  the 


error-free  bit  occurred  before  or  after  the  two  successive  errors. 

These  similar  events  must  not  be  confused  with  the  dependence  that 
exists  in  the  error  stream,  P(l/l)  / P(l/l,l) 

The  equations  for  P (1,1,1)  and  the  fourth  independent  equation, 
P(l, 1,1,1),  are  developed  in  the  same  manner  as  P(l,l)  and  yield 

P(l,l,l)  = {(1  - A)PElC(l  - A) PEI  + APE2]  + APE2LBPE1  + (l  - B)PE2)]} 

• BPEl/ (A  + B) 

+ {BPElC(l  - A) PEI  + APE2]  + (l  - B)PE2[BPE1  + (l  - B)PE2]} 

• APE2/(A  + B)  (18) 


and 

( 

p(i, l.i.i) 

= {(1  - A)PElC(l  - A)PE1((1  - A) PEI  + APE2)  + APE2(BPE1  + (l  - B)PE2)] 
+ APE2[BPE1((1  - A) PEI  + APE2)  + (1  - B)PE2(BPE1  + (1  - B)PE2)]} 

• BPEl/ (A  + B) 

+ {BPEl£(l  - A)PE1((1  - A) PEI  + APE2)  + APE2(BPE1  + (1  - B)PE2)] 

+ (1  - B)PE2CBPE1((1  - A) PEI  + APE2)  + (1  - B)PE2(BPE1  + (1  - B)PE2)]} 

• APE2/(A  + B)  (19) 

Each  of  the  four  independent  equations  has  a different  order  of 
magnitude  in  the  model  parameters.  Solving  these  equations  for  the 
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model  parameters  will  yield  some  high-order  polynomials.  The  problem 
could  be  reduced  by  assuming  PE2  to  be  a constant.  For  non-renewal 
channels,  PE2  = .5  is  the  best  approximation  (Refs  4i627jll:1260;l6:60) . 
This  assumes  that  a one  and  a zero  sure  equi probable  in  the  message,  and 
the  receiver  uses  some  sort  of  threshold  technique.  The  impulsive 
noise  that  causes  burst  errors  would  cause  the  entire  received  message 
to  be  above  the  receiver  threshold  during  the  burst.  The  receiver 
output  data  would  be  correct  approximately  half  the  time  (the  bits 
that  should  have  been  above  threshold) , and  in  error  approximately 
half  the  time  (the  bits  that  should  have  been  below  threshold) . 

Solving  Eq  (12)  for  A yields 


Substituting  this  into  Eq  (16)  and  solving  for  B yields 

. _ P(l.l) (PE2  - PEI)  + PE12(P(1)  - PE2)  + PE22(PE1  - P(l)) 

B " (PE2  - PEl)*(pEl  - P(l)) (21) 

Substitution  of  these  values  into  Eq  (17)  to  solve  for  PEI  led  to  a 
ninth  degree  polynomial  in  PEI.  Attempts,  so  far,  to  reduce  this 
polynomial  have  failed.  It  seems  reasonable  that  most  of  the  roots 
of  this  polynomial  could  be  eliminated  by  the  restrictions  that 
exist  on  PEI.  First,  PEI  must  be  real  and  in  the  range  (0,1).  In 
addition,  PE2  (assumed  to  be  .5)  must  be  greater  than  PEI  by  several 
orders  of  magnitude  because  the  random  errors  have  a much  lower  density 
than  burst  errors.  Third,  PEI  must  be  greater  than  zero  or  the  model 
becomes  a renewal  process. 

The  ninth  order  equation  only  arises  for  non-renewal  channels. 

For  random  channels  PE2  = 0 and  PEI  =1  , so  only  A and  B must  be 
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found.  For  renewal  channels  only  one  error  producing  state  is  needed, 
so  PE2  = 0 can  be  used.  PEI  would  then  simulate  the  burst  errors  in 
the  model.  Eqs  (12)  - (17)  become  simplified.  The  relative  frequency 
suggested  by  Gilbert  (for  his  model  with  only  one  error  state)  can  be 
used.  With  PE2  = 0 the  equations  for  A and  B become 


= B(PE1  - P(l) ) 

P(l) 


B = P(1)PS1  - P(l.l) 
PEI  - P(l) 


( 


Gilbert  uses  C = p{x  l^lj^+^p(l  0 l)  "to  re<iuce  the  or<ier  of 
magnitude  of  the  model  parameters  in  his  third  independent  equation. 
Converting  his  notation  and  equation  to  the  form  used  here  yields  an 
equation  for  PEI  (Ref  11i1260). 

\2r 


pei  = 


(22) 


Thus,  the  generalized  Gilbert  model  can  produce  the  correct  results  for 
renewal  processes  and  random  processes  as  special  cases  of  the  parameter 
values. 

An  iterative  procedure  to  solve  for  the  model  parameters  in 
the  general  case  is  discussed  in  the  next  chapter. 

Two  more  equations  must  be  developed.  First,  it  should  be 
shown  that  this  model  does  in  fact  produce  a dependent  error  bit 
stream.  Second,  the  goal  of  this  paper  is  to  develop  an  equation 
for  P(N  = n)  . 
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Proof  of  Dependence 


The  proof  of  dependence  in  the  error  bit  stream  requires  two 
inequalities.  P(l)  ^ P(l/l)  shows  dependence,  but  the  two-state 
model  for  the  state  sequence  is  first-order.  Therefore, 

P(l/l,l)  / P(l/l)  is  needed  to  prove  that  the  bit  sequence 
dependency  goes  beyond  first-order.  Using  Bayes  rule,  these  two 
inequalities  can  be  converted  to  P(l)2  f P(l,l)  and 
P(l,l,l)  f P(l,l)2/P(l) • Multiplying  both  sides  by  a constant 
doesn't  change  the  inequality,  but  does  eliminate  the  denominator. 

(A  + B)2P(1)2  = (A  + B) (BPE12  + ABPE1PE2  - ABPE12  + APE22 

+ ABPE1PE2  - ABPE22) 


Combining  and  factoring  yields 

(A  + B)2(P(1,1)  - P(l)2)  = (PE2  - PEl) (A) (B) (1  - (A  + B))  f 0 

This  inequality  holds  if  PEI  f PE2  , A ^ 0 , B j-  0 and 
A + B ^ 1 . These  are  the  same  restrictions  imposed  to  prevent  the 

model  from  becoming  a Bernoulli  random  process.  P(l/l,l)  / P(l/l) 
becomes 

(A  + B)(APE2  + BPEl)P(l,l,l)  ^ (A  + B)(APE2  + BPEl)P(l,l)2/P(l) 
Multiplying  these  out,  combining  and  factoring  yields 
(PEI  - PE2)2[l  - (A  + B)]2  j 0 

This  inequality  holds  if  PEI  f PE2  and  A + B / 1 , and  both 

restrictions  are  already  imposed.  These  inequalities  hold  for  any 
sequence  of  bits  put  into  the  probability  equations.  Thus,  even 
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though  the  state  sequence  is  first-order  Markov,  the  bit  sequence  has 
higher-order  dependencies  - it  is  not  first-order  Markov. 

Development  of  P(N  = n) 

A pattern  can  be  seen  in  the  equations  developed  for  the  various 
joint  probabilities,  but  it  isn't  a form  convenient  for  notations. 
Comparing  Eqs  (ll)  and  (12)  to  Eqs  (13)  - (16),  and  then  to  Eqs  (18) 
and  (19).  shows  that  the  addition  of  a bit  aads  new  terms  to  the  inner- 
most product  of  the  equation.  For  a given  block  length,  k,  P(N  = n) 
would  be  the  sum  of  those  joint  probability  equations  for  k bits  that 
contain  n errors.  A more  convenient  notation  can  be  developed. 

Using  Bayes  rule 

P(N  = n)  = E F(N  = n/SicSic_i***S1)P(SfcSk-i,,,S1) 

where  the  summation  is  over  all  the  2^  state  sequences,  • • *S]_ . 

Using  the  Markov  property  of  the  state  sequence  (see  Eq  (5))  yields 

F(»  * n)  - r P(H  - n/SkSk.i"-Si)P(Sk/Sk.1)”-P(S2/S1)P(Si)  (23) 
leqB&Sis  ~ 

A convenient  notation  can  be  developed  for  P(N  = n/Sk**^)  . The 

sum  of  independent  Bernoulli  events  has  a binomial  distribution.  The 
two  interleaved  Bernoulli  processes  of  the  model  can  then  be  expressed 
as  the  product  of  the  two  binomial  distributions.  This  is  done  by 
dividing  the  k states  into  two  groups  and  the  n errors  into  two 
groups  using  the  following  notations. 

k = the  length  of  the  block  of  bits 
n = the  number  of  errors  in  the  block 
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kq  = the  number  of  times  state  NP1  occurs  in  a given  set  of  k states 
k2  = the  number  of  times  state  NP2  occurs  in  a given  set  of  k states 
n]_  = the  number  of  errors  that  occur  in  state  NP1  in  a given  set 


* 


1 


( 


of  k states 

n2  = the  number  of  errors  that  occur  in  state  NP2  in  a given  set 
of  k states 


where 


k = kq  + k£ 
n = nq  + n2 


Thus,  with  this  notation,  a single  summation  is  used  on  this  product  of 
binomial  distributions. 


min(n,kq)  , n-> 

P(N  = n/Sfc* • *Sq)  = Z (^1)PE1  (1  - PEI) 

ni  = 0 1 


ki-np 


(jj2)pE2n2(l  - PE2)k2“n2  (24) 


Thus,  for  a given  sequence  of  states  P(N  = n/S^* • *Sq)  is  the  average  of 
all  the  possible  ways  n errors  could  occur  in  the  state  sequence. 

The  unconditional  probability  of  n errors,  P(N  = n),  is  the  conditional 
probability  averaged  over  all  possible  state  sequences. 

This  concludes  the  development  of  the  model  and  of  the  estimation 
procedures.  The  testing  of  the  model  and  the  relative  frequency 
estimation  with  computer  simulation  are  discussed  in  the  next  chapter. 
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V Test  Results 


This  chapter  discusses  the  results  of  three  computer  programs 
used  to  test  the  model.  A computer  program  has  been  designed  to 
generate  an  error  stream  based  on  the  model  parameters.  One  purpose 
of  this  program  was  to  determine  if  the  model  would  produce  a "bursty" 
error  stream.  Also,  each  of  the  model  parameters  are  varied,  one  at 
a time,  to  show  their  effect  on  the  bit  stream.  Second,  the  program 
is  modified  to  test  the  convergence  of  the  relative  frequency  estimates 
of  P(l) , P(l,l),  and  P(l,l,l).  A third  program  was  created  to  test  a 
simple  iterative  procedure  using  successive  approximation  to  estimate 
the  model  parameters  from  the  independent  equations. 

Model  Test 

The  simulation  program  used  to  generate  an  error  sequence  uses  a 
random  number  generator  function  (RANF)  that  is  uniform  over  the  range 
(0,1).  The  generated  random  number  is  tested  against  the  transition 
probabilities  to  determine  which  state  the  model  is  in.  If  the  random 
number  generated  is  less  than  or  equal  to  B/ (A  + B) , the  initial  state 
is  NP1,  otherwise  it  is  NP2.  Then,  a second  random  number  is  generated. 
Based  on  the  state,  the  random  number  is  tested  against  the  error  rate. 
If  the  random  number  is  less  than  the  error  rate,  the  bit  is  a one; 
if  not,  it  is  a zero.  After  the  initial  condition,  all  state 
transitions  are  based  on  the  current  state.  For  example,  if  currently 
in  state  NP1,  the  state  will  be  changed  to  NP2  if  the  random  number 
generated  is  less  than  or  equal  to  transition  probability  A;  otherwise 
the  state  remains  NP1.  Random  numbers  axe  generated  to  test  the  state 
transition  and  the  error  rate  for  every  bit  in  the  error  stream 
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simulation.  The  program,  its  flow  chart,  and  the  error  streams  it 
generated  can  be  found  in  appendix  A. 

A short  test  of  2000  bits  was  used.  This  was  a compromise  to 
have  enough  bits  to  detect  the  burst  tendency,  and  still  have  a small 
enough  sample  to  manually  analyze  the  gap  distributions.  The  model 
parameters  were  selected  to  show  burst  errors  and  gaps  in  a small 
sample,  rather  than  to  fit  any  known  channel  characteristics.  The 
parameters  were  A = .01  , B = .1  , PEI  = .001  , and  PE2  = .5  . 

The  values  of  B and  PE2  mean  the  average  burst  will  be  about  ten  bits 
long  and  have  a density  of  about  .5.  The  values  of  A and  PEI  mean 
the  average  gap  between  bursts  will  be  about  100  bits  long,  and  about 
every  tenth  between-bursts  gap  has  a random  error  splitting  it  into 
two  smaller  gaps.  The  generated  error  stream  would  average  out  to 
these  values  if  the  test  sample  were  large  enough  (relative  frequency) . 
The  test  data  produced  very  well  defined  bursts  with  a density  of  about 
.5  and  an  average  length  of  9.25  bits.  The  relatively  error-free  bits 
between  bursts  were  well  defined  also,  and  averaged  214  bits  (due  to 
two  gaps  of  over  400  bits).  There  were  a total  of  two  random  errors. 
The  model  parameters  values  tested  above  will  be  referred  to  as  the 
base  data  test. 

To  test  the  model's  flexibility,  PEI  was  increased  to  .01  and 

all  the  other  parameters  remained  the  same  as  in  the  base  data  test. 

The  number  of  random  errors  increased  to  eleven.  Thus,  the  error 

stream  was  affected  as  predicted  by  the  change  in  the  model  parameter. 

The  average  burst  length  increased  to  18  bits,  but  this  was  due  to  one 

very  long  burst  of  100  bits.  The  average  number  of  bits  between 

bursts  was  125,  closer  to  the  expected  value  with  A = .01  . 

37 


1 


1 


( 


In  the  next  test  A = .001  , and  the  other  three  parameters  were 

set  to  the  values  of  the  base  data  test.  The  average  burst  length 

* 

remained  the  same,  the  number  of  random  errors  went  back  down  to  two, 
but  the  average  number  of  bits  between  bursts  Increased  to  400.  Again, 
the  bit  stream  reacted  to  the  parameter  change  as  predicted  by  the  model. 

The  third  test  used  B = .01  with  the  other  three  parameters  set 
to  the  values  of  the  base  data  test.  As  expected,  the  only  signifi- 
cant change  In  the  error  stream  was  that  the  average  length  of  a burst 
had  Increased  to  110  bits.  The  fourth  test  used  PE2  = .9  as  the 

only  change  from  the  base  data  test.  Here,  the  only  significant  change  - 

was  the  density  of  the  error  burst. 

These  tests  have  shown  that  the  model  can  produce  burst  errors.  ; 

In  addition,  it  has  shown  that  each  of  the  model  parameters  does 
affect  the  bit  stream  as  predicted.  Thus,  by  varying  the  model 
parameters,  any  desired  distribution  of  errors  can  be  simulated  by  the 
generalized  Gilbert  model. 

The  gap  distribution  is  often  used  to  analyze  a channel 
(Refs  9 l 10 i 11 j 12).  These  tests  of  the  model  parameters  can  be 
analyzed  from  that  viewpoint.  Each  test  was  broken  into  twenty 
100-bit  blocks.  Thus,  the  longest  possible  gap  is  100  bits.  This 
was  done  so  that  a scale  could  be  used  to  show  the  changes  in 
probability  for  small  gap  lengths.  P(0m)  is  the  probability  of  m 
consecutive  error-free  bits.  P(m)  is  defined  as  the  probability  that 
the  gap  length  is  greater  than  or  equal  to  m bits.  Thus,  P(m)  is  the 
anti cumulative  first-order  probability  distribution  (Ref  12 « 1189-90). 
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Anticumulative  gap  distributions,  Base  Data  A = .01,  B = .1,  PEI  = .001,  PE2 


1 


(25) 


T 


( 


m-1 

P(m)  = 1 - E P(On)  m-1 
n=0 

P(m)  =1  m = 0 

Fig  7 is  a plot  of  P(m)  versus  gap  length.  Note  how  the  changes 
In  the  model  parameters  change  the  distribution  of  the  gap  lengths. 

If  P(m)  were  plotted  on  a log  scale,  it  would  have  an  exponential 
decay  similar  to  the  VHF  channel  plot  in  Haddad,  et  al.  (Ref  12:1191). 
This  seems  to  establish  that  the  model  has  face  validity,  but  further 
testing  should  be  done. 

Relative  Frequency 

The  same  computer  simulation  was  used  to  generate  the  error 
stream  based  on  the  model  parameters.  However,  in  this  program 
relative  frequency  was  tested  for  accuracy  in  estimating  P(l),  P(l,l) 
and  P(l,l,l).  The  program  and  its  flow  chart  can  be  found  in 
appendix  B. 

Each  bit  in  the  error  stream  that  is  a one  increments  the  P(l) 
counter.  The  P(l,l)  counter  is  incremented  if  the  current  bit  and  the 
previous  bit  are  both  ones.  The  P(l,l,l)  counter  is  incremented  if 
the  current  bit  and  the  two  previous  bits  are  ones.  These  counter 
values  axe  then  divided  by  the  total  number  of  bits,  total  minus  one, 
and  total  minus  two  respectively  to  get  the  relative  frequency 
estimates  of  the  probabilities.  Table  I contains  the  results  of 
these  tests.  Note  the  percent  error  at  2000  bits  is  10  - 19%»  but  for 
a one-million  bit  sample  the  percent  error  is  reduced  to  1 - 2%. 
Relative  frequency  should  converge  much  faster  than  this  for  a 
Bernoulli  random  process.  The  rather  slow  convergence  indicates  the 
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number  of  bits 
in  sample  run 

P(l) 

P(l.l) 

P(l.l.l) 

2,000 

.0415 

.0165082541 

.0075075075 

(10 .4958) 

(19.33*) 

(18.47#) 

50,000 

.04768 

.0216604332 

.0099603984 

(2.84#) 

(5.84#) 

(8.16#) 

250,000 

.04434 

.0197720791 

.0092360739 

(4.36#) 

(3.38#) 

(0.3*) 

1,000,000 

.046894 

.0207420207 

.0093700187 

(1.144#) 

(1,356#) 

(1.752*) 

calculated 

.0463636364 

.0204645364 

.0092086694 

values 

Eq(l2) 

Eq(l6) 

Eq(l8) 

NOTES i 

(1)  Values  in  Parentheses  are  the  percent  error,  using  the 

G - El 

formula  error  # - ^ x 100  where  C is  the  calculated 

value  and  E is  the  experimental  value. 

(2)  These  tests  used  a computer-simulated  error  bit  stream 


based  on  model  parameters  A = .01  , B * .1  , 

PEI  = .001  , and  PE2  = .5  • 


I 


' 
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memory  of  the  model,  ie.  the  dependency  in  the  bit  stream.  However, 
relative  frequency  is  a valid  estimation  procedure  for  the  generalized 
Gilbert  model.  Sampling  over  intervals  of  several  hundred-million  bits 
or  more  should  yield  probability  estimates  with  less  than  1 % error. 

This  seems  reasonable  for  the  bit  rates  and  testing  periods  outlined 
by  AFCS  . 

The  tests  conducted  to  this  point  indicate  that  the  model 
performs  as  predicted,  and  has  the  flexibility  needed.  In  addition, 
the  bit  stream  estimation  procedure  converges  toward  the  actual 
probability  values,  and  the  sampling  intervals  should  be  long  enough 
to  insure  sufficient  accuracy. 

The  only  shortcoming  of  the  model  at  this  point  is  solving  PEI 
for  non-renewal  channels.  The  next  test  involves  the  use  of  a 
simple  successive  approximation  routine  to  solve  for  PEI. 

Successive  Approximation 

Since  PEI  was  not  readily  solvable,  this  section  uses  a simple 
iterative  procedure  in  am  attempt  to  solve  the  three  independent 
equations  for  the  three  unknowns  A,  B,  amd  PEI  (PE2  = .5).  However, 
since  PEI  is  a polynomial,  there  may  be  several  values  of  PEI  that 
will  solve  the  equations.  Thus,  there  is  some  concern  that  the 
solution  attained  here  will  not  be  unique. 

An  equation  in  the  form  f(x)  = 0 can  be  rewritten  as  x = F(x) 
To  solve  for  the  roots  of  f(x)  put  an  initial  approximation,  x^,  into 
F(x)  and  solve  for  X2»  the  second  approximation.  X2  is  then  put  into 
F(x)  which  yields  the  third  approximation,  X3. 

xj+i  = F(xj)  (26) 
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This  successive  approximation  will  converge  if  |F'(x)|<  1 (Ref  5:168). 

The  equations  for  P(l) , P(l,l),  and  P(l,l,l)  can  be  put  in  the 
form  f^A.B.PEl)  = 0 , f2(A,B,PEl)  = 0 and  f3(A,B,PEl)  = 0 and 
then  rewritten  as 

A = Fi(A,B,PEl) 

B = F2(A,BtPEl) 

PEI  = FjfA.B.PEL) 

For  the  non-renewal  case,  these  three  model  parameters  must  be  less 
than  one  and  greater  than  zero.  Thus,  bounds  can  be  placed  on  the 
approximations  to  aid  convergence.  These  procedures  were  implemented 
with  a computer  program,  but  it  failed  to  converge. 

Eq  (26)  can  be  rewritten  as 

Xj+i  = (1  - H)xj  + HF(xj)  (27) 

where  the  convergence  could  be  enhanced  by  the  choice  of  H (Ref  5:168). 
In  addition,  tighter  bounds  can  be  placed  on  the  model  parameters.  It 
is  reasonable  to  assume  that  PEI,  the  random  error  rate,  will  be  at 
least  two  orders  of  magnitude  less  than  PE2,  the  burst  error  rate  or 
density.  Also,  A should  be  at  least  one  order  of  magnitude  less  than 
B,  meaning  the  gaps  between  bursts  will  be  at  least  ten  times  longer 
than  the  bursts.  These  changes  axe  incorporated  in  the  computer 
program  in  appendix  C.  AHAT,  BHAT,  and  E1HAT  axe  the  symbols  used 
for  F^(A,B,PEl),  F2(A,B,PE1),  and  F^AjB.PEl)  respectively.  The 
program  is  a simple  loop  computing  new  approximations  for  the  parameters, 
and  substituting  them  back  into  the  equations.  This  program  uses  the 
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calculated  values  for  P(l) , P(l,l),  and  P(l,l,l)  in  the  iteration 
equations.  These  values  are  the  same  ones  used  in  the  base  data  test 
and  the  relative  frequency  test,  except  A = .007. 


Fifty  iterations  were  used  to  determine  if  the  approximations 
were  converging  or  diverging.  Various  initial  approximations  within 
the  parameter  bounds  were  tested.  Various  values  of  H were  also 
tested.  It  was  found  that  H < 10“^  kept  the  parameter  approximations 
within  the  bounds.  However,  only  two  of  the  three  parameters  would 
converge  at  the  same  time  to  the  known  model  parameter  values.  It 
appears  that  the  existence  of  more  than  one  solution  to  PEI  is 
responsible  for  the  failure  of  this  iteration  procedure.  There  are 
a multitude  of  iteration  procedures  that  could  be  attempted.  However, 
there  is  insufficient  time  to  search  for  one  that  will  work. 

The  model  testing  and  relative  frequency  testing  indicate  that 
the  generalized  Gilbert  model  can  be  used  for  real-time  burst  error 
modeling.  The  iteration  procedure  did  not  succeed,  but  there  are  other 
iterative  routines  that  should  be  attempted.  They  will  be  discussed 
in  the  conclusions  and  recommendations  that  follow. 
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VI  Conclusions  and  Recommendations 


The  discussions  in  this  paper  lead  to  several  conclusions 
concerning  real-time  burst  error  modeling.  Based  on  these  conclusions, 
some  recommendations  are  made  for  continued  study  on  this  topic. 
Conclusions  are  discussed  first,  covering  what  has  been  accomplished. 
Recommendations  axe  in  the  last  section.  They  suggest  possible 
approaches  for  further  work. 

Conclusions 

One  of  the  main  thrusts  of  this  paper  was  to  find  a suitable 
model  for  burst  error  analysis  on  a read-time  basis.  The  Intended 
use  of  the  model  created  restrictions  on  the  model  choice.  The  best 
choice,  based  on  the  criteria,  is  the  generalized  Gilbert  model.  This 
is  a rather  uncomplicated  model  that  produces  the  dependency  that 
exists  in  the  bursts  and  the  dependency  that  exists  in  the  gaps.  Yet, 
the  model  is  flexible  and  can  model  renewal  channels  and  random 
channels  as  special  cases  of  the  general  model. 

There  is  another  advantage  of  this  model.  Because  it  doesn't 
vary  with  time,  relative  frequency  can  be  used  to  estimate  probabilities 
from  the  real-time  bit  stream.  The  probabilities  chosen  can  be  easily 
obtained  from  bit  streams  at  bit  rates  up  to  20  MBPS.  The  simple 
logic  circuits  needed  to  increment  the  counters  are  shown  in  Fig  8. 

Since  reliable  estimates  can  be  formed  in  a time  period  on  the  order 
of  a minute  or  less,  the  stationarity  assumption  seems  justifiable. 

The  next  step  was  to  define  these  probabilities  in  terms  of  the 
model  parameters.  This  was  accomplished,  and  it  was  determined  that 
PE2  must  be  fixed  to  retain  tractability . For  many  non-renewal 
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channels,  It  appears  that  PE 2 * .5  is  the  logical  choice.  For 
renewal  and  random  channels  PE2  = C can  be  used.  The  one  flaw  at 
this  point  was  solving  for  the  three  model  parameters  from  the 
probability  equations  for  non-renewal  channels.  No  suitable  method 
of  reducing  the  polynomial  in  PEI  was  found.  The  iterative  solution 
attempted  in  Chapter  V failed  also. 

Recent  developments  indicate  two  iteration  procedures  that  may 
solve  the  problem  of  estimating  the  model  parameters  A,  B,  and  PEI 
from  the  three  independent  equations.  One  approach  would  be  to  use 
the  Newton-Raphson  iteration.  This  requires  solving  the  inverse 
Jacobian  of  the  three  equations  to  be  used  in  the  iteration  equation 
(Ref  5«319).  The  second  approach  uses  a subroutine  in  the  AFIT  library. 
The  subroutine  MINUM  is  part  of  the  B INDECK  library  of  subroutines, 
and  is  based  on  a Sperry  Rand  Report  (Ref  19) . It  uses  a combination 
of  random  steps,  gradient  steps,  averaging  steps,  and  jump  steps. 

This  procedure  was  tested  once  using  the  same  model  parameter  values 
of  the  previous  iteration  technique  in  Chapter  V.  The  results 
converged  to  within  0.1#  of  the  actual  parameter  values  using 
2000  iterations. 

The  other  goal  was  to  define  P(N  * n)  in  terms  of  the  model 

parameters.  This  probability  equation  allows  calculation  of  all  the 

burst  statistics.  P(N  = n)  is  an  important  statistic  in  selecting 

an  error  correcting  code  (Refs  4j9) . The  equation  developed  for 

P(N  = n)  in  Eq  (23)  and  Eq  (24)  appears  formidable  for  large  block 

lengths,  k.  The  summation  over  2^  state  sequences  doubles  for  each 

bit  added  to  the  block  length.  But  this  is  misleading.  Many  of 
v 

these  2 state  sequences  are  equivalent.  The  joint  probabilities 


developed  earlier  are  a good  example.  The  probability  of  one  error 
in  a two  bit  block  is  P(0,l)  + P(l,0).  However,  as  shown  earlier, 
P(0,l)  * P(l»0)  . Thus,  only  one  event  need  be  calculated. 

Similarly,  P(l,0,0)  = P(0,0,l)  , so  the  probability  of  one  error 

in  a three  bit  block  would  require  the  calculation  of  only  two 
separate  events,  2P(1,0,0)  and  P(0,1,0).  Thus,  an  algorithm  could 
be  developed  to  take  advantage  of  this  property  and  reduce  the 
calculations  considerably.  Time  is  a factor  in  the  relative  frequency 
estimates,  but  not  much  of  a factor  here.  P(N  = n)  would  only  be 
computed  periodically  during  the  test  period,  allowing  at  least  five 
or  ten  minutes  for  its  calculation.  Specialized  hardware  could 
further  speed  up  the  process.  In  fact,  the  relative  frequency 
estimates  compiled  during  each  five  to  ten  minute  segment  could  be 
stored  in  memory.  Thus,  there  need  not  be  any  time  constraint  on 
calculating  P(N  = n)  for  each  five  or  ten  minute  update  period. 

The  final  conclusion  is  that  the  generalized  Gilbert  model  seems 
capable  of  modeling  all  types  of  channels  on  a real-time  basis.  It 
has  the  potential  of  becoming  a valuable  asset  in  channel  analysis. 

Recommendations 

There  are  several  areas  that  merit  further  study.  First, 
additional  investigation  into  reducing  the  polynomial  in  PEI  should 
be  made.  Once  this  is  done,  the  model  should  be  tested  with  a real 
data  stream.  The  development  of  an  algorithm  to  calculate  P(N  = n) 

0*0 

would  be  the  next  step,  followed  by  the  building  of  an  actual  device. 

The  relationship  used  by  Gilbert  to  reduce  the  polynomial  in 
PEI  for  his  renewal  model  (PE2  = 0)  leads  to  the  belief  that  some 
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such  relationship  exists  that  would  reduce  the  polynomial  in  PEI 
for  the  non-renewal  model.  Even  the  reduction  of  this  polynomial  to 
a cubic  or  quadratic  would  make  the  problem  workable. 

The  testing  done  on  the  model  in  this  paper  was  all  computer 
simulation.  Thus,  the  second  step  of  the  continuation  should  be  to 
determine  the  model  parameters  from  the  error  stream  of  an  actual 
communications  channel.  The  model  parameters  generated  by  the  test 
could  then  be  used  in  the  simulation  program.  The  relative  frequency 
estimates  from  the  actual  channel  could  be  compared  to  those  of  the 


simulation.  They  would  determine  if  the  estimated  model  parameters 
generate  an  error  stream  similar  to  the  actual  error  stream. 

The  third  step  would  be  to  develop  an  algorithm  for  computing 
P(N  = n)  for  any  desired  block  length,  k.  The  algorithm  would  be 
based  on  Eqs  (23)  and  (24),  and  could  incorporate  some  of  the 
properties  of  the  joint  probabilities  that  were  discussed  earlier. 

This  algorithm  should  be  designed  for  use  in  an  existing  micro- 
processor, or  perhaps  for  compatability  with  some  special  purpose 
hardware . 

The  iteration  procedures  discussed  in  the  conclusions  as 
potential  solutions  should  be  investigated  further.  It  appears 
that  they  could  be  implemented  easily  in  the  microprocessor  needed 
to  compute  P(N  = n) . An  iteration  procedure  should  be  used  if  the 

A# 

PEI  polynomial  can't  be  reduced  to  a lower-order. 

The  last  step  in  completing  the  research  would  be  the  construction 
of  an  actual  device.  This  device  would  use  the  error  bit  stream  as 


an  input.  The  bit  stream  would  use  logic  circuits  of  the  type  shown 
in  Fig  8 to  estimate  the  probabilities  P(l) , P(l,l),  and  P(l,l,l) 


( 


by  relative  frequency.  From  these  estimates,  A,  B,  and  PEI  will  be 
estimated  based  on  the  equations  developed  here,  and  the  reduced 
polynomial  of  PEI  recommended  in  step  one.  The  algorithm  of  step 
three  will  then  calculate  the  P(N  = n)  for  a specified  block  length 
(determined  by  an  external  switch  or  dial) . This  device  should  not 
be  overly  expensive  because  of  its  simplicity,  and  could  be  of  great 
value  to  AFCS  during  their  channel  tests. 
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Appendix  A 


Program  to  Simulate  an  Error  Bit  Stream 


The  program  contained  In  this  appendix  uses  given  values  for 
the  model  parameters  to  generate  a bit  stream  based  on  the  model.  A 
simplified  flow  chart  is  presented  also.  Figures  (9)  through  (13) 
are  the  actual  bit  streams  generated.  The  symbols  used  in  the  program 
are  defined. 


GA 

GB 

PEI 

PE2 

RVN 

RVE 

C(J) 

M 

TOTAL 


model  parameter  A,  obtained  from  the  data  card 

model  parameter  B,  obtained  from  the  data  card 

model  parameter  PEI,  obtained  from  the  data  card 

model  parameter  PE2,  obtained  from  the  data  card 

randomly  generated  number  to  determine  the  state  of  the  model 

randomly  generated  number  to  determine  the  bit  errors  for 
the  given  state 

array  of  100  bits  generated  by  the  program 
the  number  of  100  bit  blocks  generated 
the  total  number  of  bits  generated 


Flow  Chart  for  Burst  and  Gap  Pattern  Test  Program 


[start: 


SEED  RANFI 


[PRINT  BIT  STREAM 


THE  DESIRED 
NUMBER  CF  BITS 


.GENERATE 


YES 


PROGRAM  THESIS  (IMd'JT  = /80,OUTPUT  = /13?) 

INTEGER  C(100) 

READ*, GA»G9, PE 1»3E2 

CALL  TIME  (C) 

CALL  RANSET  (C) 

RVN=RANF (DUMMY ) 

IF(RVN«LE«GA/(GA*3P)  > WP  = 2 
IF (RVN.GT • GA/ ( GA  +GB) ) NP=1 
M=  2 0 

00  10  L= 1 » M 
DO  20  J*l,100 
IF(NP.EQ.2)  GO  TO  40 
RVN*P ANF (OUMMY ) 

IF(RVN.LE.GA)  NP=2 
PVE*RANF (DUMMY ) 

IF(RVE.LE.PEl)  GO  TO  30 
C(J)  = 0 
GO  TO  20 
30  C(J)s  l 
GO  TO  20 

40  PVN*RANF (DUMMY) 

IF(RVN.LE.GB)  NP=1 
RVE*RANF ( OUMMY ) 

IFCRVE.LE.PE2)  GO  TO  4C 
C(J)  = 0 
GO  TO  20 
45  C(  J)  = 1 
20  CONTINUE 

WRITE  100,  C 

100  FORMAT (IX, 5011 /IX, 5111) 

10  CONTINUE 

TOTAL*  M* 1 00 
PRINT* " 

PRINT*,**  ** 

PRINT*, -GIVEN  MODEL  PAPAMETERS** 

PRINT* ,"  " 

PRINT*, "GAs  GA 
PRINT*, "GBs  «,G9 
PRINT*, -PEls  ",PE1 
PRINT*, -PE2=  ”,PE2 

PRINT* J -NUMBER  OF  BITS  IN  THE  TEST*  ”,TOT 

PRINT*,"  - 
ENO 


00000  00  000000000001  00  01000000111111  00  00  00  000000C00 
00300000000000000000000000000000000 00 00 00 C00030CQ0 

0000000000000000000  00 00000101011110  01 10  00 00  0 0 00000 
00000000000000000 00 00000000000000000000 00000000000 
0 00 00 000000000000  00  00 000 0000 0000000 0000  00  CO  03  JO  000 
0 00 00 00 0 000000000  00  00 00000000000000 00 00  00  GO  0000000 

00000000000000000  00  COOOOOOOOOOOOOOOOOOO  00  00  0000  000 
011  0001 11 111  00000  00  00 00000000000000 00 00  00 00  0000000 

0 00 00 00 0000000000  000000000000000000 00 00  00  GO  000  000  0 
00000 00 000 00 00 000 00 0000000000000000 00 00 00 00 0000000 
00000000000000000 00 00 000000000000 00 00 00 00 00 0000 000 
0 000  000  0 0000  000.00  00  00  0000000  000  00  0 0 0000  00  000000000 

00000000 00  go  00 00000 00 0000 00 00 00 10 00 0000  00  00  OOOOGOO 
0000000000000000000 00000000000000000000 00000000000 
000 00 00 0000000000 00 00 00000000000000 00 01 0100 110 0000 
00000  000000000000  00  00 00000000000000 00 00  00 00  0000000 
0000000030000000000 00000000000000000003 00 000000000 
00000 00 00000 00000 00 00 00000000000000 00 00 00 00 0000000 
000 00 0000000 00 000 00 000 0000 000 000000 00 00 00 00 0000000 
00000 00 00000 00  000  00  00 0000 00 00000000 00 00  00 000000000 
OOOOOOOOOOOO 00 000000000000000000000 00 00 00000000000 
00000000000000000000000000000000000000000000000000 
0 00 00 00 OOG 00 00000  00  0000000000000000 00 00  00 000 0 00000 
00000 000 0000 00000 00 0000000000 00000 000 00 0000 00 00 000 
0 00 000000000  00 Q1010  000000000000000  0 00 00  00  GO OOOOGOO 

0000 0000000000 00 o 00 0000000000 0000 010100 10 00 10 10 110 

00000 000 0000 00000  00  GO 00000000000000 00 00  00 OOOOOOGOO 
00000 00 0000000000 00 00 00000000000000 00 00 00 03 0000000 
00000000000000000000000000000000000000000000000000 
000 00 0000000 00 00000 00 00000000000000 00 00 00 OOOOOOPOO 
00000 00 00000 00 000 00 00 00000000000000 00 00 00 00 OOOOGOO 
00000 00 00000 00 000  00  00 OOOOOOOOCOOOOO 00 00  00 OOOOOOPOO 
OOOOOOOOOOOO  00000  00  00000000000000000000  0000  000  0 GOO 
00000 00 000 00  00 00 000 00 0000000000 00 00 00 00  00 000000110 
00000 00 00 000 00000 00 00 00000000000000 00 00 0000 0900000 
00000000000000000000000000000000000000000000000000 

00000000000000000000000000000000000000000000300100 
0000000 00 OOOOOOOOOOOO 00000000000000 00 00 01 00 11 01000 
00000000 00 00 00 000 00 00 00000000000000 00 00 00 OOOOOOGOO 
0 00 0 000 00000 00 000  00 0000000000000000 00 00 00 00  0000000 


GIVEN  MODEL  PARAMETERS 

GA  = *01 
GB*  .1 

PEI*  .001 
PE2*  .5 

NUMBER  OF  BITS  IN  THE  TEST*  2000. 


Figure  9»  Bit  Stream  Produced  by  Base  Test  Data 
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000000003000  00  000001000030000000000  00  03  00  COOOOOOOO 
0 00 000000000  00 000  00  CO OOOOOOOOOOCOOO 00 00  03  JO  0300000 
0 00  000000010  11000  00  COOOOCllOOOOOOOOOOOOOOOOOOOOOOO 
00000  00 00000  00000  00  00 OOOOOOOOOOOOOOOCOO  00  00  00  0 O'1 0 0 
0000000130000000  000  0000000000000300  00  00  33000300300 
00111 11 0101001000  00  00 00000000000000 00 00  00  00  0000300 
000000000000 00000 00 00000000000000000000 00 300000000 
00 00000000 00  00 00000  00 0000000000 00 00 00 00  00  000110100 
0 00  00 00 00000  00 000  00  000000 00 OOCOOOOO 00 00  GO  00  00  00000 
000000000000  00  00000  00 oooooooocooooooooo  oooo  OOOOCOO 
0 00 000000000 00 000  00  00 000  00000000000 00 03  00  C3  0030000 
011 100010100 11 01111 0300000000000010 00 00 0000 0000 000 
0 00 00 10 00000  00 000  00  00 OOOOOOOOCOOOOOOOOO  00  00  OOOOCOO 
0 00 000000000 00 000  00  CO OOOOOOOOCOOOOOOOOO  00  00  0100000 
0 00 300000000 00 000 00 COOOOOOOOOOOOOOO 00 000000 000 0001 
000 00 0000000 00 00000 00 OOOOOOOOCOOOOOOOOO 00 000000000 
0 00 00  00 00000 10 01011  11 0010110100101010 11  01  JO  Oil IP  01 

0 00 00 00 0 00 00  00 00000  00 00000000000000 00 00  00 coooooooo 

0 00  00  00  0000000000  00  0000000000  C' 000000000  0000  0)00000 
00000 00 0000000000  00  00 00000000000000 00 00  00  00  OOOOCOO 
0 00 00 00 00000  00 000  00  00 OOOOOOOOCOOOO  0 00 00  00000300000 
000000000000  00  000  00  OOOOOOIOOOCOOOOOCOOO  00 oo  0000  000 
000 0000 0000000000  00  0010010010000000 00 00  0000  0110  000 
001 11 10 00 01 0 10 11100  010 11 0 01 11 001110  1100  10 01111110  0 
0 00 00 00 00000  00 000  00 00 00000000000000 00 00  00 GO  030000  0 
00000 00 0000000000  00  00 00000000000000  00 00  00 00  00  30000 

000 00 0003000 00 00000 00 00000000000000 00 00 00 oooooocoo 

000000000000  00  000  00  0000000000G00000  0003  00  00  0100000 
00000 00 00000 00 010  10  00 0000000000000000 01  00 000300"11 
00 1100110000 00 000  00  00 0 00 000000000  00 00 00  00 000100"00 
00000 00 000 00 00000  00 00 OOOOOOOOCOOOOOOOOO  00 000000  coo 
000 00 0000000 0000000 00 0000000000 00 00 00 00 00 00 0000000 
000000000000 00 00000  00 00000000000010 00 00  00 00  000  0000 
00000 00 00 000  00 000  00  00 00000000000000 00 10  00 CO  OOOOPOO 
00110 11 01000 11 10101 11 010 11000000000 00 11 01 10 0300P00 
00000 0000000 00000 00 000000 0000 000000 0000 00 00 000 0100 
00000 00 00000  00000  00  CO 00000000  0000000000  00 CO  0000  000 
000 00 00 00 000 00 00000 000 00 000 OOCOOOOO 00 00 00 00 OOOOCOO 
000 01 00 00000 00 000  00  0111011111000100 00 00  00 COOOOOOOO 
0 00 00 00 00000  00 000  00  00 0 00 00000000000 00 00  oo COOOOOOOO 


GIi/EN  MODEL  PARAMETERS 

GA*  .01 

GB*  . 1 
PEI*  .0 1 

PE2*  .5 

NUMBER  OF  BITS  IN  THE  TEST*  2000. 

Figure  10.  Bit  Stream  Produced  with  Parameter  PEI  Changed 
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00003 00 OOOOO 00 OOOOOCOOOOOOOOOCOOGOO 00 03 00 000 100000 
000000000000  00000  00  0000000000000000  00  00  00  00  cn  0000 

00000  00 00000  00 000  00  0000000000C  00000  00  00  0000  000  0000 
0000  00000000  00000  00  0000000000000000  00  00  00000300000 
000000003000 00 000 00 00 OOOOOOOOCOOOOO 00 00 00 00 0330C00 
000000003003  00 000  00  0000000000000000  00  00  00  30  OQOPCOO 
000000000000  00000  00  00  00000000000000  00  00  30  00  0300000 

ooooooooooaoooooooooooooooooocoooiooooooooaooooroo 
00101 0001000  00 000  00  CO oooooooooocooo  00 00  00  ooooooooo 
000000000000  00000  00  0000000000000000 00 00  00  00  0000000 
000000003000  00  000  00  0000000000000000  00  00  00  JO  00 30000 
000 00 00 00000  00 000 00  00 OOOOOOOOCOOOOO  00  00  00  0003  3 0000 
000000000000  00 000  00  0000000000  0000000000  00  00  0000000 
0 00 00 00 00000  00 00000  00 OOOOOOOOCOOOOO 00  00  00  ooooooooo 
000000000000  00 000  00  CO 00000000000000  00 00  00 00  0 300000 
000000000000  00000  00  00 00000000000000 00 00  GO  GO  0330  0 00 
000000000000  OOOCO 00  CO OOOOOOOOCOOOOO 00 OOOOCO  0000000 

ooooooooooooooooooocoooooooooooooooooooooooooooooo 
0000000000 00 00 00000  OOOOOOOOOCCOOOOO  00  00  00  ooooooooo 
000000000000  00  000  00  00 00000000000000  00  01  000000 0 0000 
0 00 OOOOOOOOO  00 00000  00 00000000000000  00 00  GO  00  000  0000 
000030000000  Ooooo  00  0000000000000000  00 00  00  00  03G0G00 
0 00 OOOOOOOOO  00 000  00  CO  00000000000000  00 00  00  303000000 

0 00  00 00 OOOOO  00 000  000000000000000000 00 03  00 GO  0030000 
000030000000  00 000  00  CO OOOOOOOOCOOOOO  00 00  00  00  030  0000 
OOOOOOOOOOOOOOOOOOOOOOOGCOOOOCOOCOOOOOOOOOOOOOCGOO 
000030000000  OOOOO  00  00000000000000000000  0000  0000  GOO 
00000000300000000  OOOOOOOOOOOOCOOOOO 00 00  00  OOOOOOOOO 
001 000111000 10 10110 00 OOOOOOOOCOOOOO 00 0000000000000 

000 OOOOOOOOO 00 000 00 0000000000000000 00 00 00000300000 
000000000000  00 000  00  00 00000000  000000 00 00  00 03  0000 "GO 
000000000000  00 000  00  00 00300000  000000 00 00  03 OOOOOOOOO 

0 00 00 00 00000  00 000  00  0010001001100000 00 00  00  CO oooocoo 
000000000000 00 000  00  CO  00000000000000 00 00  00  0000 ooooo 

000000000000 OOOOO 00 00000000000000000000 00000030000 
000000000000 00 000 00 0000000000000000 00 00 00 000110 101 
11010111011000100000000000000000000000000000300000 
000000000000  00 000  00  0000000000000000  00  00  00 00  000  0000 
OOOOO 00 OOOOO  00 000  00  00 000000000000  00 00 00  00  CO  00  30000 
OOOOO 00 OOOOO 00 000000000000000 COCOOO 00 00000003 ooooo 


GIVEN  MODEL  PARAMETERS 

GA«  .001 
GB=  • 1 
PEI*  .0  01 
PE2*  .5 

NUMBER  OF  BITS  IN  THE  TEST*  2C00. 


Figure  11.  Bit  Stream  Produced  with  Parameter  A Changed 
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0001011  1000011010  10  11000  10000100010  00  03  1010 0J00C01 

110  10  10  10000  0 coil  01 11 0110 1010100101 01 01 01 10 110 lp00 
000  1110010101100111  01010  000U1 Clio  11 01 11 01 00 oooocoo 

0 00 00  00 0000000000  00  OOOOOOOOOOCOOOOO  00  00  00  000300000 

00000000000000000 00 0000000000000000 00 00 00 00000 ocoo 

00000  00 0000000000C0  0000000000000000  0000  00  00  000  0001 
0 01  00  11 1010100000  00  OOOOOOOOOOCOOOOO  00 00  00 CQOOOOOOO 
10 00100  10111 1111010  10 1010 10  01  CO  13 01  CO  01 00 110101011 
110 11100 100010 110 10 0101100010110100 01 01 11 01 0111111 
01010010111010011100110010000010101001000000100000 
00000  00 03000  00000  00  0000000000000000  00  00  00  00  0000000 
00000  00 0010001011  10  1111100010000001 01 00  00  00  1011110 
0000110000000101111  1101100010100010  11  11  00  101301110 
001010113010  0100C  01  10100  010011  01000  0110  11  101111101 
100 0 111 01001000  11  11  00 0100  11 01101000  10 00  00  11  0000101 
10100 00  1001011010  10  0000000000000030  00 00  00300010000 
00000 00 00000 0000000 OOOOOOOOOOCOOOOO 00 000300 0000 000 

00  000000000000000  00  0000000000  0 000000000  00030  0 00000 
OOOOO  00 0000000000  00  00 00000000000000  00  00  00  00  0000  000 

00000 00 0 0000  00000  00  CO 00000000000000  00 00  00  00  0000000 
0000000000011001P100010101101110000 00 01 00 030110111 
00100  10 0010001011  10  000001010010100  111  11  0011  000  1000 
11 010 11  OHIO  11 11100  110110 01  00000000  00 00  00  000300000 

ooooooooooooooonooocooooociiicoioioioco 00000011011 
liiioiiio ii oiiiioioioiioioooiciiiioii ii ii loioiiroi 

1110111010  00  0101010  1Q 0010 1001 1100 10 10 10  00 11  0110  11  1 
00000001100100000100101111010000010 01 10 01100000000 
OOOOO  0003000  OOOOO  00  OOOOOOOOOOCOOOOO  00  00  OO'IOOOOOOOO 
OOOOO  00 0030000000  00  OOOOOOOOOOCOOOOO  0000  00  000000000 
OOOOOOOOOOOOOOOOOOOCOOOOOCOOOGOOOOOOOOOOOOOOIOOCOO 
000000000011 10 110 10100011C100000000 00 00 00000000000 
OOOOO  00  00 10 100111  10  01 00101010110100 00 10  10  no 0010C10 
11110  110  10111110  0 10  00 111 10101 C OCOO  0 00  10  11  0 0 0 0 0 0 0 10 
101 000000000  OOOOO  00  00000000000011100001  10 DO  13  01001 
0 11 10 10 01 01 010 01110100 11 01100C 10 OGlOlOO  11  010301010 
0 00 1000100100001011C011000101110010 01 0101110101100 
00011001000000000  00  00 OOOOOOCOOOOOOO  00 00  OOOOOOOOCOO 
0 00 00 00 0000000000 00 C3000000G0C000 00 00 03 00 030000000 
000003000000 OOOOO 00 00 00001000 100001 01 11 10 1101 11100 
00011010100110011001000001111111111001000111310001 


GIVEN  HOOEL  PARAMETERS 

GA=  .01 
GB*  .01 
PE1=  .001 
PZ2-  .5 

NUMBER  or  BITS  IN  THE  TEST  = 2C00. 


Figure  12.  Bit  Stream  Produced  with  Parameter  B Changed 
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00000000300000000 00 CQOOOOOOQOC003QOCC 00 03 00 11 :nnQO 
000000000330  00 OCO  0C  0000300000000000000303  0 0 0330  000 
000000003000  OOOOO  00  C300000003CCC0j0  0003  3000  111  1111 
000030000030 30 OOOOOPOOOOOnOGOCGOOOO 00 PO33PO030O3OO 
OOOOO 00 OOOOO  00 00000C000"000000000 0 0 00 03  33  003030  000 
OOOOO 00 OOOOO  OOOOO  00  00000000000003000003  3000  3330 r01 
1111111111311113000  C300000000C003000000  03  G3  00  JO  COO 
000000000000  OOOOO 00  eaOCOOOOGOOOGOOOCOOO  00  300000003 
OOOOO OQOO 001 01111111111 1 111 10C000G0 CO  03  00 000300000 
000000003000  OOOOO  03  C0000000000003300003  0300  0330^00 
OOOOO 00 OOOOO  00030  00  C300000000C00300  00 00  33  300  3 30000 
000000000000 00 000O0C3000O0000C0C330 00 03 30 J0Q3J00J0 
0 00  000000000  00 003  00  OOCGOOOOOOCCOOOO  00  00  03  030333000 
0 00 000003000  OOOOO  OOCOGO 3 000300000C00000  00  103300^00 
003000000000 00 OOOOOC3OO3OPOGOCOOO00 00 3303u3033000C 
0000  30003000  00  OCO  10  111  OOCCOliUOlll  11 11 11 111111111 
11 1111111110  00 000  00  OOOOOOOOOOt  0030  0 00  03  30  U00  3 3 0300 
OOOOO 00 OOOOO 00 POOOO CO C0000000G00300  11 11  11 11  1011111 
111111101111 11 lit  11 130C0000000003000000  00  3003J0C00 
OOOOO 00 OOOOO  CO 000  00  03000111 11  111003  00  30  03  00  030  OCO 0 
000 000003000 00 000 00 COOOOOCOOOCOCOOOGO 30 00 G3 030 000 n 
000000003 10 003 000 00 C000300000C00300 0000 0300 0103000 
000000000000  OOOOO  00  0300300000  PC030C00  00  00  00  030  0 0 00 
000030000000  00  OOOOOOOOOOOOOOOCOO3COOO333OO0O '3  OOOOO 
000 0300000 00 00 OPOOOCOOOOOOOOOCOOOOOOOOO 03 P00330r00 
0 00 00 00 0 0000  00 000  00  COOOOOOOOOGOCOO COO  000000030  0000 

000 00 00 OOOOO 00 OPOOOOOOOOOPOOOCOOOOO 30 00 00 300300000 
000 0000 00 000 00 OPOOOOOOCOOOOOOOOOO 00 30 00 30 300330300 
000000000000  00 OOOOO  00  0 11 HOGOOOOOOO  11  10  00 000300C0C 
000000003000  OOOPO 00  COOOOOOCOOCCOOOlOaOO  03  011000000 
0000  3 0000000  00  OCOOO  00  OOOOOOOOCOQOOO  00  00  10  oomooooo 
000000000000  00 000  00  COOOOOOOOO 0 00300  00  00  00 00  000  0000 
00000000000000030000000000000000000330000000000000 
000000000000  OOOOO 00  COOOOlllllllllli 11 11 11 111110111 
110000000000  00 000  00  COOOOOOOOO  0 00000  0000  3000  0000000 

OOOOO  00  00000  00 000  DO  OOOOOOOOOOCOOGOOOO  00  03  0 0 03  0 OCO 0 
00000000  3000  00 OCO GO COOOOOPOGO COOOOOOOOO  0000  CO  30000 

000 00 00 OOOOO 00 00001 11 111 111 11 110000 00 00 00 G00030C00 
OOOOO 00 OOOOO 00 000  00  GOOOOOOOUOCOOOOO 00  GO  03  GO  0300000 

oooooooooooo  ooocooocoooooooooc  ocooooooo  oocooaoo',oo 


GIVEN  MOTEL  PARAMETERS 

G A*  .01 
Ge=  .1 
PEI*  .001 
PE2*  .9 

NUMPER  QP  9ITS  IN  TKE  TESTs  2000. 

Figure  13.  Bit  Stream  Produced  with  Parameter  PE2  Changed 
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; 
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Appendix  B 

Program  to  Test  Relative  Frequency  Estimation  Convergence 

This  program  uses  the  same  technique  to  generate  an  error  bit 
stream  as  used  in  appendix  A.  It  also  tests  successive  bits  to  count 
errors,  overlapping  pairs  of  errors,  and  overlapping  triple  errors. 

M was  varied  to  test  bit  streams  of  2000  to  one-million  bits.  This 
program  contains  symbols  defined  in  appendix  A,  plus  these  symbols. 


PI  = counter  of  error  bits,  then  divided  by  the  total  number  of 
bits  to  yield  P(l) 

PR11  = counter  of  overlapping  pairs  of  consecutive  errors,  divided 
by  total  - 1 to  yield  P(l,l) 

PR111  = counter  of  overlapping  triple  consecutive  error,  divided 
by  total  - 2 to  yield  P(l,l,l) 

T1  = temporary  storage  for  the  99th  bit  in  the  array  so  it  can 
be  tested  with  the  first  bits  of  the  next  array 

T = temporary  storage  for  the  100th  bit  in  the  array  so  it  can 
be  tested  with  the  first  bits  of  the  next  array 

W = used  as  default  so  the  first  time  through  the  loop  T & T1 
won't  be  tested  against  the  first  array 


C 
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L 1 


Flow  Chart  for  Relative  Frequency  Program 
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PROGRAM  THESIS  (IN  P')Ts/8Q, OUTPUT  s/132) 
INTEGER  C(100) 

REA0*,GA,GB,PEl,BE2 
CALL  TIME  (C) 

CALL  RANSET  (C) 

RVN=RANF(OUMMY) 

IF(RVN.LE.GA/(GA+GB>  ) NP*2 

IF (RVN .GT . GA/ ( GA ♦SB) ) NP=1 

Pl=  G.O 

PR11=0.0 

PRll 1=  0.0 

T*  0.0 

T 1=  0.0 

W=0. 0 

M=  20 

no  10  L*1 * M 
DO  2 0 J=  1,10  0 
IF (NP • EO . 2)  GO  TO  40 
RVN=RANF (DUMMY) 

IF(RVN.LE.GA)  N»s2 
RVE=PANF ( DUMMY ) 

IF (RVE.LE. PEI)  GO  TO  30 
C(J)  a 0 
GO  TO  20 
30  C(J)=  1 

PI*  PI  ♦ 1.0 

GO  TO  20 

40  RVN=RANF (DUMMY ) 

IF  CRVN.LE.GB)  N»  = l 
RVE=PANF (DUMMY) 

IF (RVE.LE. PE2)  30  TO  4F 
C(  J)  = 0 
GO  TO  20 
45  C( J)=  1 

Pl=  Pi  ♦ 1.0 
20  CONTINUE 

IF(H.EO.O.O)  GO  TO  50 
IF (C  ( 1) . EO .0)  GO  TO  50 
IF(T.EO.O.O)  GO  TO  50 
IF(C(1).EQ.1.0)  PRlls  PR11  ♦ 1.0 
IF(Tl.EQ.l)  PR  11 1*  ®R1 1 1 ♦ 1.0 
IF (C ( 2) . EO .1)  PR  11 Is  PR111  ♦ 1.0 
50  CONTINUE 
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I 


00  6 0 <=1,99 


IF 

(C 

(to  . EQ.O 

.0) 

o to  r 

0 

IF 

(C 

(<♦1) 

EQ 

.1  . 

0) 

0*11  = 

PR11 

1.3 

IF 

(C 

(<♦!) 

EQ 

.0) 

J 

0 TO  f 

0 

IF 

(K 

. E0.99 ) 

GO 

TD 

60 

IF 

(C 

(<♦2) 

EQ 

.1) 

D 

* 111  = 

PR111 

♦ 1.0 

60  CONTINUE 

IP(M.GT.l)  W=  1.0 
T 1 = C (99) 

T = C(100) 

10  CONTINUE 

TOTAL*  M* 1 00 
Pl=  PI/ (TOTAL) 

PR11=  PR11/(T0TA_-  1) 

PR111 = PRlll/( TOTAL-2) 

CALP 1=  (G9*PEl  ♦ 3 A*  PE?)  / (GA  *G9) 

CAL11=  ((PEI  «■  GA*(0£2  - PE1))*G9*°E1  + 

•/.  (PE2  ♦ G9*  (®E1  - PE2)  )*GA*PE2)  ' 

*/  (GA  *G9) 

CALI 11=  ( (G9*OEi*  (PE1  + GA* (PE2-PEI) ) ♦ ( 1-G9) * ®E2* ( 

’/.  PE2+G9*  (PE1-PE2)  ))  *GA*PE2*  ( (1-SA)  *®E1*  (»E1+GA‘  ( 

% PE2-PE1) )*GA*PE2*(PE2*G9* (PE1-3E2)  ) ) *GB* PEI > / ( GA +GR) 
PRINT*,’*  “ 

PRINT*, ’’Pd)  = ”,®1,”  P(l,l>=  ",»M1,"  0(1,1, 1)=  ”,PR111 

PRINT*, **CALC  P(l)=  ”,CAlP1»**  CALI  ®<1,1>  = ” , 

*/  C A L 1 1 , **  CALC  o(l,  1,1)=  ** , CAL  11 1 

PRINT*, **  ** 

PRINT*, "GIVEN  MOTEL  PARAMETERS’* 

PRINT*, **  ** 

PRINT*, -GA=  ”,  GA 
PRINT*, ”G9=  **,  G9 
PRINT*, ”PE1=  ”,PE1 
PRINT*, **PE2=  ”,PE2 
PRINT*,-  “ 

PRINT*, -NUM9ER  0-  9ITS  IN  THE  TEST*  ”, TOTAL 
PRINT*,”  ” 

ENO 


Appendix  G 

Program  of  Successive  Approximation 


This  program  uses  a loop  of  successive  approximations  of 
the  model  parameters  based  on  Eqs  (26)  and  (27)  and  the  independent 
equations  P(l),  P(l,l),  and  P(l,l,l).  Symbols  axe  the  same  as  those 
found  in  appendix  A plus  these  symbols. 

i 

AHAT  = equation  of  P(l)  in  the  form  of  Eq  (26) 

BHAT  = equation  of  P(l,l)  in  the  form  of  Eq  (26) 

E1HAT  = equation  of  P(l,l,l)  in  the  form  of  Eq  (26) 

A = the  successive  approximation  of  parameter  A using  Eq  (2?) 

B = the  successive  approximation  of  parameter  B using  Eq  (27) 

El  = the  successive  approximation  of  parameter  PEI  using  Eq  (27) 
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PROGRAM  THESIS  (INP'JT  = /80  ,OUTPUT  = ^132  > 

READ*  , GA  »G9, PEI, 3E2 

CALP1*  (GB*PE1  4 GA*PE2)/(GA+GB) 

CAL11*  ((PEI  ♦ GAMPE2  - PE1))*33*?E1  ♦ 

X (PE2  ♦ GBMPEi  - PE2)  )*GA*PE2)  f 
X (GA  4GB) 

CALI 11=  ( (G9*PE1* ( PE14GA*(PE2-PEL> ) 4 ( 1 -G3>  * P E2* ( 

X PE24GB* (PE1-PE2)  ))  *GA*PE24((l-G»)  *PE1*(PE14GA* ( 

X PE2-PE1))4GA*PE2MPE24GB*  (PE1->E2>>  > *G  B»°E  1)  / ( 3A  4GB) 
PRINT*,-  - 

PRINT*, “CALC  P(l)=  “, CALP1, ” CAL'  ?(1,1)=  ", 

X CAL11, “ CALC  P(l,l,l)=  “ , CAL  1 1 1 
PRINT*, “ " 

PRINT*, "GIVEN  MODEL  PARAMETERS” 

PRINT*,-  " 

PRINT*, “GA=  ”, GA 
PRINT*, ”GB=  ”, GB 
PRINT*, "PE1=  ”,  PEI 
PRINT*, ”PE2=  ”*PE2 
PRINT*,”  - 
E2=  0.5 
H*  1F-L 
A=  0.009 
B*  0.125 
El=  0.00125 
DO  110  1=  1,50 

AHAT  = (8* El  4 A*E2 )/CALPl  - B 
A*  ( 1-H) * A 4 H*AHAT 
IF(A.GT. 8/10.0)  #=  B/10.0 
IF(A.LT.lE-6)  A*  IE-6 

BHAT=  ((El  4 A*  (E2  - E1))*(B*E1)  *■  (E2  * 9ME1 
X - E2>)  *(A*E2>) /0AL11  - A 
B*  (1-H)*B  4 H*BHA T 
IF (8 .GT. 0 .5)  9*  0.5 
IF(B.LT.lE-3)  9*  IE-3 

E1HAT*(CAL111* (A4B)  - (B*El* (El*** (E2-E1) ) 4 ( l-B)  * 

X E2*  (E249ME1-E2)  ))*A*E2)/(  ((1-4)  *E1*(E14A»  CE2-E1 
X )) 4A*E2*(E24B*(E1-E2)))*B) 

El* ( 1-H) ♦ El  4 H*E1HAT 
IF(E1.GT.E2/ 100.0)  El*  E2/100.0 
IF (El ,LT . IE-6)  El=  IE-6 

PRINT*, "AHAT*  -*A,”  BHAT*  ”,B,"  El HAT*  -,E1,“  H*  ”,H 


110  CONTINUE 
ENO 
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are  related  to  estimates  of  the  model  parameters,  so  relative  frequencies 
provide  a basis  for  fitting  this  model  to  real  channels  using  observed 
error  sequences.  An  equation  for  the  number  of  errors  in  a block  of  bits 
is  developed  in  terms  of  the  model  parameters.  Burst  probabilities 
can  be  predicted  based  on  this  equation.  The  model  was  tested  using 
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